I am trying to do each day copy (each day photo) of all of the salesforce objects the usage of azure information manufacturing unit (ADF) "reproduction" interest into an azure data lake via first the usage of a lookup query pastime (soql as shown under) and then doing a foreach interest for the list of items again from this query:
WHERE IsQueryable = true
AND IsRetrieveable = true
AND IsDeprecatedAndHidden = false
But, this query also returns objects which haven't any (zero) information in any respect and that I need to bypass them. How are we able to?
Is there any area/assets metadata in salesforce's entity definition that can tell if the object has any facts in it or if it's blank, something like "isblank = authentic/false"?
As per this link:- soql does not permit matter() on entity definition object, therefore it is now not viable to find if a sure object (qualifiedapiname) has any data in it from the square question:https://developer.Salesforce.Com/docs/atlas.En-us.Api_tooling.Meta/api_tooling/reference_objects_soql_limits.Htm#subject matter-name
Running this on adfv2 with batch depending on fifty; automobile diu, and diploma of parallelism = 32. Presently, all these sfdc objects have a less wide variety of records; however sooner or later whilst it starts developing - might re-design this pipeline, in any case, to segregate small objects as every day full copy and massive sfdc items with a one-time load after which incremental hundreds using both watermark table and/or max final changed date/time method.
Subscribe to get latest updates