npackJul 29 12:17

Hello Community !!!

Im happy to open up this channel for discussing anything related to snowflake

  • Say Hi or introduce yourself
  • Talk about anything that you are up to

npackJul 30 10:50

Snowflake expands into Google cloud, with this, we have snowflake in all the three leading cloud platforms including aws and azure !

npackAug 07 05:09

What data warehouse platform are you working on now? And what's the one thing you most like about it ? 

npackAug 14 02:39

@all What are you working on, what do you need help with ?

sumitsinghcompuAug 28 10:36

hi

npackAug 28 07:49
sushil17decAug 29 11:50

Hi Everyone .. Sushil here from Amsterdam. I would like to know any real world use case on SNowflake ?? any one using snowflake in Production ??

npackAug 30 01:25

Lot of companies use Snowflake to host their datawarehouse for their analytics and operational needs. What specifically do you mean by real world use case ?

sushil17decAug 29 11:51

Can we build a Data pipeline using Snowpipe ?? 

npackAug 30 01:27

@sushil17dec Yes, It is possible to have real time streaming inserts via Snowpipe

/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/botocore/vendored/requests/api.py:67: DeprecationWarning: You are using the POST() function from 'botocore.vendored.requests'. This is not a public API in botocore and will be removed in the future. Additionally, this version of requests is out of date. We recommend you install the requests package, 'import requests' directly, and use the requests.POST() function instead.

DeprecationWarning

Traceback (most recent call last):

File "SnowPipe_Dataload.py", line 43, in <module>

resp = ingest_manager.ingest_files(staged_file_list)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/simple_ingest_manager.py", line 121, in ingest_files

response_body = self.restful.post(target_url, json=payload, headers=headers)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/utils/network.py", line 33, in post

return self._exec_request_with_retry(url=url, method='POST', json=json, headers=headers)

File "/Users/asutosh.sarangi/Library/Python/3.7/lib/python/site-packages/snowflake/ingest/utils/network.py", line 83, in _exec_request_with_retry

raise IngestResponseError(response)

snowflake.ingest.error.IngestResponseError: Http Error: 500, Message: Internal Server Error

While using snowpipe REST API, using the above error. Can anyone please help on this?

npackSep 02 04:07

Were you able to fix the problem? The error message is not helpful 

raise IngestResponseError(response)

snowflake.ingest.error.IngestResponseError: Http Error: 500, Message: Internal Server Error

This is the error message.

can anyone please look into this issue?

npackSep 04 10:43

Just the error message alone is not going to help. I am not sure what exactly you are trying to achieve. But  from what it seems, it looks like you are trying to use a deprecated function

dilipvolamSep 16 06:54

how to do datamasking in snowflake, appreciate any help on this ?

npackSep 22 02:32

@dilipvolam Datamasking is a huge topic in itself, involving various factors including if you want to see the original data back or not. Every cloud provider has few solutions to mask / encrypt data, Its a good place to start with

Copied