-
Notifications
You must be signed in to change notification settings - Fork 0
/
README
175 lines (138 loc) · 7.47 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
Use caching for everything
manifold-tables -A -o \* -f\ * -j CACHE
QUERIES A TESTER
manifold>>> select slice_last_updated from slice where slice_hrn == "ple.upmc.jordan_auge"
not a slice !!!!!!!
search user and fail...
SELECT user.hrn,slice.slice_hrn AT now FROM user WHERE user_hrn == "ple.upmc.jordan_auge"
manifold>>> SELECT slice_hrn, slice_type, user, lease AT now FROM slice WHERE slice_hrn INCLUDED ["ple.upmc.agent", "ple.upmc.nice"]
problemes avec projection
26/07/2013
OK NOW: unhashable type : list
select user_hrn, slice.slice_hrn from user where user_hrn == "ple.upmc.jordan_auge"
endless loop
TODO : missing key in UNION
SELECT slice.slice_hrn AT now FROM user WHERE user_hrn == "ple.upmc.jordan_auge"
--------------------------------------------------------------------------------
SELECT resource_hrn FROM resource WHERE slice.slice_hrn=="ple.upmc.myslicedemo"
--------------------------------------------------------------------------------
manifold>>> select source, destination, dns_target.alexa_rank from packet where dport == 53
* Infinite loop in 1..1 relationships (need seen)
* We should be able to detect the end of a query (missing is wrong)
--------------------------------------------------------------------------------
manifold>>> select slice_hrn, resource_hrn from slice where slice_hrn == "ple.upmc.myslicedemo"
* shortcuts are not handled at all to match with the query. It should fix this bug
--------------------------------------------------------------------------------
QUERY PLAN:
-----------
[5304] SELECT slice_hrn (None)
[3573] SELECT slice_hrn, lease, user, slice_type FROM ple::slice WHERE <Filter: > (<bound method Projection.child_callback of SELECT slice_hrn>)
EEE! 'slice'
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/manifold/operators/subquery.py", line 145, in run_children
parent_ids = [x for record in self.parent_output for x in record[key]]
KeyError: 'slice'
--------------------------------------------------------------------------------
manifold>>> select slice_hrn, resource.resource_hrn from slice where slice_hrn == "ple.upmc.myslice_demo"
DEBUG [manifold.core.xmlrpc_api.XMLRPCAPI.xmlrpc_forward] ['xmlrpc_api args = '] [{'AuthMethod': 'session', 'session': 'y3kDctjqyTugELXBjPodabm0VGPWInVk+/aY6BmNX8g='}, {'action': 'get', 'fields': ['slice_hrn', 'lease.start_time', 'lease.duration', 'lease.urn', 'lease.granularity', 'lease.slice_id'], 'object': 'slice', 'params': [], 'filters': [['slice_hrn', '=', 'ple.upmc.myslicedemo']]}]
--------------------------------------------------------------------------------
QUERY PLAN:
- better handling of missing fields, to be sure they are not requested later on by the query plan for example
- how to filter on missing fields ? do we have to consider a N/A value
- key fields in queries: eg. network, network_hrn
METADATA
- platform name in announces should not be set by the platform
- be careful in make_announces,we need the platform to set weird fields...
VARIABLES
- variables are replaced by the same in each query, it seems all platforms from build_union share the same query
- variables are displayed with quotes in Query
XMLRPC
- investigate lock
- make sure everything is deferred for forward in xmlrpc
GATEWAY
- ability to ping a platform
- ability to manager users
TABLE
- joins and subqueries requires that the tables have some capabilities to make the inject !!!!!!!!!!!!!!!!!!!!!!!!!!!
- how to inject in sfa
OPERATORS
- affect self.query in all optimize_* functions
- implement missing optimize_* functions
- when we push a where down after a select, it should have a select before and after...
QUERY PLAN
- fix bug in query_plan for 1..N backwards subqueries :grep relation_name
- confirm the need for second pass in query_plan
- request for an unknown object
- no table for oml::slice
> never mind
> ignore on join
AST
- shortcuts in subqueries do not appears in the AST where we have the full path
OPTIONS
- register new options
- parse at first use of options
- personalize usage()
- apply to xmlrpc, shell
- how to handle other arguments
SHELL
- autocomplete for queries + enhance with metadata
INPUT/SQL
- true sql syntax
AUTH
- raise standard error codes
File "/usr/local/lib/python2.7/dist-packages/manifold/auth/__init__.py", line 71, in check
raise AuthenticationFailure, "Password verification failed %s" % crypt.crypt(plaintext, password[:12])
GATEWAY/SFA
- slice are not filtered by type
- get slice shows authorities
- separate R and AM
- make SM feed the local:platform table
GATEWAY/TDMI
- error when no filter in provided, we always put a where
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] u'\n SELECT destination_id\n FROM destination\n WHERE \n '
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] 'Database error c29dd61e-b7c7-42ae-a73b-11095c3a1e54:'
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] ProgrammingError('syntax error at end of input\nLINE 5: \n ^\n',)
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] 'Query:'
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] u'\n SELECT destination_id\n FROM destination\n WHERE \n '
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] 'Params:'
DEBUG [manifold.gateways.postgresql.TDMIGateway.execute] 'None'
STORAGE
- make asynchronous
SHELL
- pass command in commandline/constructor for a single command to be executed
GATEWAY/CSV
- issue with non utf_8 files (try with original version in /root/datsaets/as2attr.tgz)
THEORY
- predicates in MANIFOLD for prolog like
- key in NODE ? table == predicate
- give an example of proof
ROUTER
- KeyboardInterrupt during QueryPlan construction hangs
================================================================================
Exception 2 raised by (1, 'SFAGateway', u'ple', 'SELECT slice_hrn, user, lease FROM slice WHERE <Filter: Pred(slice_hrn, ==, ple.upmc.myslice_demo)>') :
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/manifold/gateways/sfa/__init__.py", line 1310, in start
result = yield getattr(self, "%s_%s" % (q.action, q.object))(q.filters, q.params, fields)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1187, in unwindGenerator
return _inlineCallbacks(None, gen, Deferred())
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1088, in _inlineCallbacks
deferred.callback(e.value)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 367, in callback
assert not isinstance(result, Deferred)
AssertionError
===== RESULTS =====
[]
manifold>>> Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
Failure: exceptions.ValueError: Error in SFA Proxy [Failure instance: Traceback: <class 'xmlrpclib.Fault'>: <Fault 2: ": Resolve: Record not found: ['ple.upmc.myslice_demo']">
/usr/lib/python2.7/dist-packages/twisted/internet/tcp.py:277:connectionLost
/usr/lib/python2.7/dist-packages/twisted/protocols/tls.py:460:connectionLost
/usr/lib/python2.7/dist-packages/twisted/protocols/policies.py:123:connectionLost
/usr/lib/python2.7/dist-packages/twisted/web/xmlrpc.py:373:connectionLost
--- <exception caught here> ---
/usr/lib/python2.7/dist-packages/twisted/web/xmlrpc.py:444:parseResponse
/usr/lib/python2.7/xmlrpclib.py:1137:loads
/usr/lib/python2.7/xmlrpclib.py:793:close
]
================================================================================