Bash script coding

• Defensive BASH Programming 
  

Google Cloud Knowledge Notes

--- BigQuery Use Cases ## Summarize cost statistic for some logs

select sum(size_in_MiB) as total_MiB, sum(cost) as total_cost_USD from
 (select table_id, 
         sum(size_bytes)/pow(10,6) as size_in_MiB, 
         sum(size_bytes)/(pow(10,9)*2) as cost 
     from `.__TABLES__` 
     where REGEXP_CONTAINS(table_id, r"_202103.*") 
group by table_id 
order by size_in_MiB desc)

BigQuery:

JavaScript Programming Usage

Get timestamp from datetime format string:

## JavaScript code example
time = "2020-02-27T16:00:00.000Z"
"2020-02-27T16:00:00.000Z"
timestamp = Date.parse(time) / 1000
1582819200

## verify above timestamp
date -d "1970-01-01 UTC 1582819200 seconds"
Thu Feb 27 16:00:00 UTC 2020

Refer to:

• Converting a datetime string to timestamp in Javascript 
• What's the inverse of “date +%s”? 
  

JSON Usage in Python and Pandas

Python dict to json or vice  versus

• How To Convert Python Dictionary To JSON? 

Panda DataFrame and Series to JSON:

• pandas.Series.to_json 
• pandas.DataFrame.to_json 

JSON to javascript in Django framework

• How to pass data to javascript in Django Framework ? 
• JavaScript loop through json array 

Create JSON object dynamically via JavaScript (Without concate strings) 

xy_kline_data = []
for (var key in kline_data) {
    xy = { 
          x: new Date(key),
          y: [ kline_data[key]["open"], 
              kline_data[key]["high"], 
              kline_data[key]["low"], 
              kline_data[key]["close"]
          ]
    }
    xy_kline_data.push(xy)
}

Redis Administration

Secure Redis:

• Boosting Redis's Security in Four Easy Steps 
• Redis Security 
• Redis Quick Start 

Django Redis UnpicklingError:

• Django-redis-cache UnPicklingError 

Using Redis in Python:

• Python Redis