Hello Community !!!

Im happy to open up this channel for discussing anything related to snowflake

  • Say Hi or introduce yourself
  • Talk about anything that you are up to

Snowflake expands into Google cloud, with this, we have snowflake in all the three leading cloud platforms including aws and azure !

What data warehouse platform are you working on now? And what's the one thing you most like about it ? 

@all What are you working on, what do you need help with ?

Hi Everyone .. Sushil here from Amsterdam. I would like to know any real world use case on SNowflake ?? any one using snowflake in Production ??

Lot of companies use Snowflake to host their datawarehouse for their analytics and operational needs. What specifically do you mean by real world use case ?

Can we build a Data pipeline using Snowpipe ?? 

@sushil17dec Yes, It is possible to have real time streaming inserts via Snowpipe

/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/botocore/vendored/requests/api.py:67: DeprecationWarning: You are using the POST() function from 'botocore.vendored.requests'. This is not a public API in botocore and will be removed in the future. Additionally, this version of requests is out of date. We recommend you install the requests package, 'import requests' directly, and use the requests.POST() function instead.

DeprecationWarning

Traceback (most recent call last):

File "SnowPipe_Dataload.py", line 43, in <module>

resp = ingest_manager.ingest_files(staged_file_list)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/simple_ingest_manager.py", line 121, in ingest_files

response_body = self.restful.post(target_url, json=payload, headers=headers)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/utils/network.py", line 33, in post

return self._exec_request_with_retry(url=url, method='POST', json=json, headers=headers)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/utils/network.py", line 83, in _exec_request_with_retry

raise IngestResponseError(response)

snowflake.ingest.error.IngestResponseError: Http Error: 500, Message: Internal Server Error


While using snowpipe REST API, using the above error. Can anyone please help on this?

Were you able to fix the problem? The error message is not helpful 

raise IngestResponseError(response)

snowflake.ingest.error.IngestResponseError: Http Error: 500, Message: Internal Server Error


This is the error message.


can anyone please look into this issue?

Just the error message alone is not going to help. I am not sure what exactly you are trying to achieve. But  from what it seems, it looks like you are trying to use a deprecated function

how to do datamasking in snowflake, appreciate any help on this ?


@dilipvolam Datamasking is a huge topic in itself, involving various factors including if you want to see the original data back or not. Every cloud provider has few solutions to mask / encrypt data, Its a good place to start with

Copied