Azure Synapse Serverless - Error handling external file: 'IO request completed with an error. ERROR = 0x00000057&#39

admin管理员组

文章数量:1430061

I'm running a Azure Data Factory pipeline, which also runs SQL queries against .parquet files in Storage Account Datalake attached to a Synapse Serverless Database in order to create new external tables with CETAS (CREATE EXTERNAL TABLE AS) expression. The query looks like:

IF OBJECT_ID('DatabaseName.tmp.TableName') IS NOT NULL DROP EXTERNAL TABLE DatabaseName.tmp.TableName;

CREATE EXTERNAL TABLE DatabaseName.tmp.TableName 
WITH (
    LOCATION = 'space=tmp/table=TableName/',
    DATA_SOURCE = myDataSource,  
    FILE_FORMAT = myFileFormat (parquet)
) AS 
SELECT * FROM DatabaseName.dbo.TableName;

The problem is I have 50% chance to get an error with the message like :

Operation on target Creat TMP Table failed: Error handling external file: 'IO request completed with an error. ERROR = 0x00000057'. Underlying data description: table 'DatabaseName.dbo.TableName'

However, if I run the pipeline one more time, it runs successfully. After a while I can run it one more time, and I'll get an error. I would be glad if someone could point out the cause of this failure.

I'm running a Azure Data Factory pipeline, which also runs SQL queries against .parquet files in Storage Account Datalake attached to a Synapse Serverless Database in order to create new external tables with CETAS (CREATE EXTERNAL TABLE AS) expression. The query looks like:

IF OBJECT_ID('DatabaseName.tmp.TableName') IS NOT NULL DROP EXTERNAL TABLE DatabaseName.tmp.TableName;

CREATE EXTERNAL TABLE DatabaseName.tmp.TableName 
WITH (
    LOCATION = 'space=tmp/table=TableName/',
    DATA_SOURCE = myDataSource,  
    FILE_FORMAT = myFileFormat (parquet)
) AS 
SELECT * FROM DatabaseName.dbo.TableName;

The problem is I have 50% chance to get an error with the message like :

Operation on target Creat TMP Table failed: Error handling external file: 'IO request completed with an error. ERROR = 0x00000057'. Underlying data description: table 'DatabaseName.dbo.TableName'

However, if I run the pipeline one more time, it runs successfully. After a while I can run it one more time, and I'll get an error. I would be glad if someone could point out the cause of this failure.

• io
• azure-synapse

Share Improve this question Follow asked Nov 19, 2024 at 14:11 OlehOleh 6166 bronze badges 2

• Are you able to create external table successfully? – Bhavani Commented Nov 19, 2024 at 14:37
• Hi @Oleh Please check the below answer and let me know if it fits your requirement or not? – Bhavani Commented Nov 20, 2024 at 18:21

Add a comment  | 

1 Answer 1

Sorted by: Reset to default 0

Operation on target Creat TMP Table failed: Error handling external file: 'IO request completed with an error. ERROR = 0x00000057'. Underlying data description: table 'DatabaseName.dbo.TableName'

According to this

It seems that the issue is related to IO errors when querying external files in Azure Gen2 storage. This can happen if the files are being written to while the query is running, or if there are issues with the network connectivity or storage performance. That may be the reason to get above error.

• Ensure the files being queried are static and not modified during the pipeline execution.
• Check if there are other services or processes accessing or modifying the files simultaneously.

By following above instructions, I was able to run pipeline successfully to create external table in serverless pool as shown below:

External table:

For more information you can refer to the similar thread.

本文标签：