When our automation call external Match API to process a large JSON payload ( approx. 2.75 – 3 million records in payload), external match API is returning either Invalid token or Gateway time out error. Just so you know,it works fine for a volume less than 2 million records. I have listed error output below. Please let me know if there are any limitation on number of records in JSON payload – our automation called this api for processing approx. 2.75 million records thrice this morning approx., 10 AM EST – API calls are running External match API in a distributed mode with 4 partitions. if you could troubleshoot from Reltio side by looking at logs.
<title>504 Gateway Time-out</title>
<h1>504 Gateway Time-out</h1>
If you execute the following API, it will show you that the external match limit for this tenant is set to 500k for prod, 100k for test and 50k for the dev environments.
When you upload the file, the following file size limitations exist:
- The file size limit allocated for a "csv" file is 33 GB. Make sure the file size does not exceed 50 MB, when you upload a file from the local file system.
- The file size limit allocated for a JSON file is 50 MB, irrespective of whether you upload the file from the local file system or remote storage.