How to append data from a DataFrame to BigQuery without needing a "bigquery.table.create" role

Hello Everyone!!

I am facing a issue in a solution that I am developing, let me explain my scenario.

I need to append in an existing table information from a csv, I created a cloud function triggered by eventarc which runs when a Object is finalized in a storage bucket.

The problem is that when attempting to append the new data, an error occurs stating that my service account needs the `bigquery.table.create` role/permission on the dataset. However, in my company, in production environment, that role is prohibited because It is considered as a high-level permission.

I have already tried using load_job and pandas.togbq. Unfortunately, in both cases, the error is the exact same.

Does anyone have any suggestions or alternative solutions to bypass or solve this issue? Any advice would be greatly appreciated!

Thanks