tidwall 6257ddba78 Faster point in polygon / GeoJSON updates
The big change is that the GeoJSON package has been completely
rewritten to fix a few of geometry calculation bugs, increase
performance, and to better follow the GeoJSON spec RFC 7946.

GeoJSON updates

- A LineString now requires at least two points.
- All json members, even foreign, now persist with the object.
- The bbox member persists too but is no longer used for geometry
  calculations. This is change in behavior. Previously Tile38 would
  treat the bbox as the object's physical rectangle.
- Corrections to geometry intersects and within calculations.

Faster spatial queries

- The performance of Point-in-polygon and object intersect operations
  are greatly improved for complex polygons and line strings. It went
  from O(n) to roughly O(log n).
- The same for all collection types with many children, including
  FeatureCollection, GeometryCollection, MultiPoint, MultiLineString,
  and MultiPolygon.

Codebase changes

- The pkg directory has been renamed to internal
- The GeoJSON internal package has been moved to a seperate repo at
  https://github.com/tidwall/geojson. It's now vendored.

Please look out for higher memory usage for datasets using complex
shapes. A complex shape is one that has 64 or more points. For these
shapes it's expected that there will be increase of least 54 bytes per
point.
2018-10-13 04:30:48 -07:00

95 lines
2.1 KiB
Go

package controller
import (
"bytes"
"strings"
"time"
"github.com/tidwall/btree"
"github.com/tidwall/resp"
"github.com/tidwall/tile38/internal/glob"
"github.com/tidwall/tile38/internal/server"
)
func (c *Controller) cmdKeys(msg *server.Message) (res resp.Value, err error) {
var start = time.Now()
vs := msg.Values[1:]
var pattern string
var ok bool
if vs, pattern, ok = tokenval(vs); !ok || pattern == "" {
return server.NOMessage, errInvalidNumberOfArguments
}
if len(vs) != 0 {
return server.NOMessage, errInvalidNumberOfArguments
}
var wr = &bytes.Buffer{}
var once bool
if msg.OutputType == server.JSON {
wr.WriteString(`{"ok":true,"keys":[`)
}
var everything bool
var greater bool
var greaterPivot string
var vals []resp.Value
iterator := func(item btree.Item) bool {
key := item.(*collectionT).Key
var match bool
if everything {
match = true
} else if greater {
if !strings.HasPrefix(key, greaterPivot) {
return false
}
match = true
} else {
match, _ = glob.Match(pattern, key)
}
if match {
if once {
if msg.OutputType == server.JSON {
wr.WriteByte(',')
}
} else {
once = true
}
switch msg.OutputType {
case server.JSON:
wr.WriteString(jsonString(key))
case server.RESP:
vals = append(vals, resp.StringValue(key))
}
}
return true
}
if pattern == "*" {
everything = true
c.cols.Ascend(iterator)
} else {
if strings.HasSuffix(pattern, "*") {
greaterPivot = pattern[:len(pattern)-1]
if glob.IsGlob(greaterPivot) {
greater = false
c.cols.Ascend(iterator)
} else {
greater = true
c.cols.AscendGreaterOrEqual(&collectionT{Key: greaterPivot}, iterator)
}
} else if glob.IsGlob(pattern) {
greater = false
c.cols.Ascend(iterator)
} else {
greater = true
greaterPivot = pattern
c.cols.AscendGreaterOrEqual(&collectionT{Key: greaterPivot}, iterator)
}
}
if msg.OutputType == server.JSON {
wr.WriteString(`],"elapsed":"` + time.Now().Sub(start).String() + "\"}")
return resp.StringValue(wr.String()), nil
}
return resp.ArrayValue(vals), nil
}