Jul 22 01:28:01.809153 ip-10-0-136-148 systemd[1]: Starting Kubernetes Kubelet... Jul 22 01:28:02.911013 ip-10-0-136-148 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:28:02.911013 ip-10-0-136-148 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 01:28:02.911013 ip-10-0-136-148 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:28:02.911013 ip-10-0-136-148 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 01:28:02.911013 ip-10-0-136-148 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:28:03.006097 ip-10-0-136-148 systemd[1]: Started Kubernetes Kubelet. Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.912202 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921099 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921112 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921117 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921121 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921125 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921128 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921132 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921136 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921139 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921143 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921147 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921150 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921153 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921163 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921167 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921170 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921174 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.023792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921177 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921181 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921184 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921188 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921192 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921195 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921199 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921203 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921207 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921210 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921216 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921221 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921225 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921229 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921232 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921236 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921239 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921243 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921246 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921250 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.025679 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921253 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921257 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921260 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921264 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921269 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921273 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921277 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921282 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921286 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921290 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921294 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921299 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921303 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921306 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921309 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921313 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921316 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921319 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921323 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.026688 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921328 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921333 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921338 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921341 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921345 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921348 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921353 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921356 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921360 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921364 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921368 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921373 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921376 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921380 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921383 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921387 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921391 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921394 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921398 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921402 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.027848 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921405 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921409 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921413 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921416 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921420 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921423 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921427 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921431 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921435 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921439 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921442 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921446 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921450 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921454 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921457 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921461 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921464 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921468 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921471 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921475 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.030760 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921478 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921482 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.921486 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923366 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923376 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923380 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923385 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923389 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923393 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923396 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923399 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923403 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923406 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923410 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923414 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923418 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923421 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923425 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923428 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923432 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.031799 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923435 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923439 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923442 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923446 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923449 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923452 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923456 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923460 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923463 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923467 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923470 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923473 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923476 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923481 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923485 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923488 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923492 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923495 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923499 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923502 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.032913 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923505 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923508 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923512 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923515 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923519 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923523 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923526 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923530 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923533 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923537 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923541 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923544 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923547 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923551 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923554 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923558 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923561 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923565 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923569 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.034633 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923593 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923600 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923605 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923609 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923613 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923617 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923620 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923623 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923627 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923630 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923634 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923637 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923640 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923644 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923647 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923650 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923654 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923659 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923665 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.037473 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923668 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923672 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923677 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923681 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923685 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923688 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923692 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923696 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923699 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923703 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923707 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923710 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923714 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923718 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923722 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923725 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923729 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923732 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923735 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923739 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923742 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.038645 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923746 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923749 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.923754 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924257 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924264 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924267 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924271 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924274 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924278 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924281 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924285 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924289 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924292 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924297 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924300 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924304 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924307 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924310 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924314 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.040474 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924317 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924321 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924324 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924327 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924334 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924338 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924344 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924348 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924352 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924356 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924360 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924364 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924367 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924371 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924374 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924377 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924381 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924386 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924390 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.041355 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924397 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924401 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924404 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924408 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924411 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924415 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924418 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924422 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924426 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924429 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924433 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924436 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924439 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924443 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924446 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924449 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924453 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924456 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924460 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924463 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924466 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.043892 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924469 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924473 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924478 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924482 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924486 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924490 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924493 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924497 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924501 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924506 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924510 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924515 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924519 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924523 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924526 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924530 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924534 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924537 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924541 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.045299 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924544 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924548 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924551 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924555 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924558 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924562 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924565 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924568 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924572 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924575 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924579 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924582 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924585 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924588 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924592 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924596 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924599 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924603 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924606 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924609 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.048398 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924613 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924616 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924619 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.924623 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.924715 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.924723 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925621 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925628 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925633 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925638 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925643 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925649 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925653 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925657 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925663 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925668 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925672 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925676 2561 flags.go:64] FLAG: --cgroup-root="" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925680 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925684 2561 flags.go:64] FLAG: --client-ca-file="" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925688 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925691 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925697 2561 flags.go:64] FLAG: --cluster-domain="" Jul 22 01:28:03.049276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925700 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925705 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925710 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925714 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925720 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925724 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925728 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925733 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925737 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925740 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925744 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925748 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925753 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925760 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925764 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925768 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925772 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925776 2561 flags.go:64] FLAG: --enable-server="true" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925780 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925785 2561 flags.go:64] FLAG: --event-burst="100" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925789 2561 flags.go:64] FLAG: --event-qps="50" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925793 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925797 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925801 2561 flags.go:64] FLAG: --eviction-hard="" Jul 22 01:28:03.051084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925807 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925811 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925815 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925819 2561 flags.go:64] FLAG: --eviction-soft="" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925823 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925827 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925831 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925847 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925852 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925856 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925860 2561 flags.go:64] FLAG: --feature-gates="" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925865 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925869 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925873 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925877 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925882 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925886 2561 flags.go:64] FLAG: --help="false" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925889 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-136-148.ec2.internal" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925894 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925898 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925902 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925909 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925913 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925917 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 01:28:03.052409 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925921 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925925 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925929 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925932 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925937 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925941 2561 flags.go:64] FLAG: --kube-reserved="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925945 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925949 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925953 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925958 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925961 2561 flags.go:64] FLAG: --lock-file="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925965 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925969 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925974 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925981 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925985 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925989 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925992 2561 flags.go:64] FLAG: --logging-format="text" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.925996 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926000 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926004 2561 flags.go:64] FLAG: --manifest-url="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926008 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926014 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926017 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926026 2561 flags.go:64] FLAG: --max-pods="110" Jul 22 01:28:03.056485 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926030 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926035 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926038 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926043 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926049 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926054 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926058 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926067 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926071 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926075 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926079 2561 flags.go:64] FLAG: --pod-cidr="" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926083 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926091 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926094 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926099 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926102 2561 flags.go:64] FLAG: --port="10250" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926106 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926111 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a1b76bf230bebcfe" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926116 2561 flags.go:64] FLAG: --qos-reserved="" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926121 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926126 2561 flags.go:64] FLAG: --register-node="true" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926130 2561 flags.go:64] FLAG: --register-with-taints="" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926134 2561 flags.go:64] FLAG: --registry-burst="10" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926138 2561 flags.go:64] FLAG: --registry-qps="5" Jul 22 01:28:03.057802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926142 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926146 2561 flags.go:64] FLAG: --reserved-memory="" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926151 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926155 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926160 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926163 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926167 2561 flags.go:64] FLAG: --runonce="false" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926171 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926175 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926179 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926183 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926187 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926191 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926196 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926201 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926214 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926218 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926222 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926226 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926230 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926234 2561 flags.go:64] FLAG: --system-cgroups="" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926238 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926245 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926249 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926253 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 01:28:03.058711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926258 2561 flags.go:64] FLAG: --tls-min-version="" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926263 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926269 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926273 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926277 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926281 2561 flags.go:64] FLAG: --v="2" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926286 2561 flags.go:64] FLAG: --version="false" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926291 2561 flags.go:64] FLAG: --vmodule="" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926296 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926301 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926460 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926465 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926471 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926476 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926480 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926485 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926488 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926493 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926497 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926500 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926506 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926510 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.060597 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926513 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926517 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926520 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926524 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926528 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926531 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926534 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926537 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926541 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926544 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926548 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926551 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926557 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926561 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926564 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926568 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926571 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926574 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926578 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.062405 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926581 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926586 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926590 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926594 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926598 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926602 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926606 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926609 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926613 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926617 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926621 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926627 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926630 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926634 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926637 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926641 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926644 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926648 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926651 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926654 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.063315 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926658 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926661 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926665 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926668 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926671 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926676 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926680 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926684 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926687 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926690 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926694 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926697 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926700 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926704 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926707 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926710 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926714 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926717 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926720 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.065105 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926724 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926727 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926731 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926734 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926741 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926745 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926749 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926753 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926757 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926760 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926764 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926767 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926770 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926774 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926777 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926780 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926784 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926787 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926792 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.066434 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926796 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926800 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926804 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926807 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926811 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926814 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926817 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926821 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926824 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.926827 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.926850 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.936873 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.936891 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.937693 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.937702 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 01:28:03.068767 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937769 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937776 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937779 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937782 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937786 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937789 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937793 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937796 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937799 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937802 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937804 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937807 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937810 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937813 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937815 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937818 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937821 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937824 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937827 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937830 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.176520 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937833 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937853 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937858 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937864 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937868 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937871 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937874 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937877 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937880 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937883 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937888 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937891 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937895 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937897 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937900 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937903 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937906 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937909 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937912 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.178632 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937914 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937917 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937920 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937923 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937925 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937928 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937931 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937934 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937936 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937940 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937943 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937946 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937949 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937951 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937954 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937957 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937959 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937962 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937965 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.179533 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937967 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937970 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937973 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937975 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937980 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937982 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937985 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937988 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937992 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.937997 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938000 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938004 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938008 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938013 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938016 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938020 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938023 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938026 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938028 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.181291 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938031 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938034 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938038 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938040 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938043 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938046 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938049 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938051 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938054 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938057 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938060 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938062 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938065 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938068 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938071 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938073 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938076 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938080 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938083 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938086 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.182190 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938088 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938091 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.938096 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938237 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938242 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938246 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938251 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938254 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938257 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938260 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938263 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938266 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938269 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938272 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938275 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:28:03.183517 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938278 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938281 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938285 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938287 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938290 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938295 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938298 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938301 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938304 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938307 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938310 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938313 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938316 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938318 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938321 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938327 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938329 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938332 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938335 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:28:03.184380 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938338 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938341 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938344 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938346 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938351 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938354 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938356 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938359 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938362 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938364 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938367 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938370 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938373 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938376 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938379 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938382 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938385 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938387 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938391 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:28:03.185270 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938394 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938397 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938400 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938403 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938406 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938408 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938411 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938414 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938416 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938421 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938424 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938427 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938430 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938432 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938435 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938438 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938441 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938445 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938448 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938451 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:28:03.186117 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938454 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938457 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938459 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938463 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938467 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938470 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938474 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938477 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938481 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938484 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938487 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938490 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938493 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938496 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938499 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938502 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938504 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938507 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938510 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938512 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:28:03.187419 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938515 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938519 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938522 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938525 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938528 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938530 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938533 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938536 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:02.938539 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.938546 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.938692 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.941135 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.943320 2561 server.go:1019] "Starting client certificate rotation" Jul 22 01:28:03.188314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.943460 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.943500 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.946958 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.948426 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.964202 2561 log.go:25] "Validated CRI v1 runtime API" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.970318 2561 log.go:25] "Validated CRI v1 image API" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.971376 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.976125 2561 fs.go:135] Filesystem UUIDs: map[18bc48a7-dcaa-4b60-98a9-fd4bc37d70e8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f5d12dfd-c753-46b6-beed-b73973cfe49a:/dev/nvme0n1p3] Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.976141 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 01:28:03.189638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.977938 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.981657 2561 manager.go:216] Machine: {Timestamp:2026-07-22 01:28:02.98114939 +0000 UTC m=+1.035858011 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089511 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2271ae0fa03fec510babb6ff2cc78d SystemUUID:ec2271ae-0fa0-3fec-510b-abb6ff2cc78d BootID:6368b315-6b38-4814-8dad-b9b836740b29 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:97:b8:d4:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:97:b8:d4:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:16:d6:40:1e:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.981762 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.981899 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.986424 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.986457 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.987271 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.987282 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.987292 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.987306 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.988675 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992298 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992463 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992495 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992508 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992526 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992539 2561 kubelet.go:398] "Adding apiserver pod source" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.992550 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 01:28:03.195458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.993033 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.993064 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.995446 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.997851 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.997892 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999151 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999170 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999180 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999188 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999200 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999208 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999535 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999547 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999557 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999565 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999579 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:02.999590 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.001214 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.001223 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.001632 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znzbt" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.003460 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.004374 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.004372 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.005111 2561 server.go:1268] "Started kubelet" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.005188 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.005985 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.006505 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.007615 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.007657 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.010865 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znzbt" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.013276 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-148.ec2.internal.18c4785aa1f424dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-148.ec2.internal,UID:ip-10-0-136-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-148.ec2.internal,},FirstTimestamp:2026-07-22 01:28:03.005080796 +0000 UTC m=+1.059789417,LastTimestamp:2026-07-22 01:28:03.005080796 +0000 UTC m=+1.059789417,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-148.ec2.internal,}" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.014746 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.018065 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.018107 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.019556 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.019949 2561 factory.go:55] Registering systemd factory Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020005 2561 factory.go:223] Registration of the systemd container factory successfully Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020049 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020070 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020274 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 22 01:28:03.196342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020296 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.020398 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020576 2561 factory.go:153] Registering CRI-O factory Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020588 2561 factory.go:223] Registration of the crio container factory successfully Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020653 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020684 2561 factory.go:103] Registering Raw factory Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.020708 2561 manager.go:1196] Started watching for new ooms in manager Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.021249 2561 manager.go:349] Starting recovery of all containers Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.031342 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.034672 2561 manager.go:354] Recovery completed Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.035140 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-148.ec2.internal\" not found" node="ip-10-0-136-148.ec2.internal" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.039900 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.042385 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.042412 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.042425 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043050 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043060 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043061 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043139 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043881 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043907 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.043920 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.044817 2561 policy_none.go:49] "None policy: Start" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.044835 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.044871 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.046200 2561 policy_none.go:47] "Start" Jul 22 01:28:03.198106 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.121134 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.319262 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.221676 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.322770 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.322221 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.455455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.422878 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.588181 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.523870 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.721518 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.624415 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.728520 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.725016 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.843609 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.825611 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.867241 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.867217 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:03.925748 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.925727 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:03.941963 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.941947 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 01:28:03.942083 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.942066 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:28:03.942125 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.942107 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:28:03.995788 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.995657 2561 manager.go:337] "Starting Device Plugin manager" Jul 22 01:28:03.995898 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.995820 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 01:28:03.995898 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.995831 2561 server.go:87] "Starting device plugin registration server" Jul 22 01:28:03.996192 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.996174 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 01:28:03.996292 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.996193 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 01:28:03.996353 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.996325 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 01:28:03.996471 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.996455 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 01:28:03.996471 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:03.996468 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 01:28:03.997100 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.997079 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 01:28:03.997177 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:03.997138 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.016272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.016244 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 01:23:03 +0000 UTC" deadline="2028-01-07 23:07:38.869777386 +0000 UTC" Jul 22 01:28:04.016272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.016269 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12837h39m34.853511765s" Jul 22 01:28:04.017825 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.017808 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-136-148.ec2.internal" not found Jul 22 01:28:04.034132 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.034114 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-136-148.ec2.internal" not found Jul 22 01:28:04.089159 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.089112 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 01:28:04.090518 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.090341 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 01:28:04.090518 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.090394 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 01:28:04.090518 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.090424 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 01:28:04.090518 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.090469 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 01:28:04.091489 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.091471 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-136-148.ec2.internal" not found Jul 22 01:28:04.092703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.092677 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:04.096903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.096881 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:04.097721 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.097705 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:04.097787 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.097737 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:04.097787 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.097750 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:04.097878 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.097789 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.104487 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.104468 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.104537 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.104491 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-148.ec2.internal\": node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.121905 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.121889 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.195022 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.194961 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal"] Jul 22 01:28:04.195145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.195062 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:04.198151 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.198118 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:04.198268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.198171 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:04.198268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.198187 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:04.199807 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.199790 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:04.199921 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.199899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.199981 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.199936 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:04.200642 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200618 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:04.200727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200652 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:04.200727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200664 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:04.200727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200630 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:04.200727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200727 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:04.200886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.200737 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:04.204024 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.204006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.204099 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.204034 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:28:04.204735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.204719 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:28:04.204810 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.204752 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:28:04.204810 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.204764 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:28:04.221998 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.221952 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.225409 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.225393 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-148.ec2.internal\" not found" node="ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.227453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.227435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.227525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.227460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3581e57e834108d06c1d0f1f0066af56-config\") pod \"kube-apiserver-proxy-ip-10-0-136-148.ec2.internal\" (UID: \"3581e57e834108d06c1d0f1f0066af56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.227525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.227479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.229680 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.229664 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-148.ec2.internal\" not found" node="ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.323056 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.323028 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.328629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3581e57e834108d06c1d0f1f0066af56-config\") pod \"kube-apiserver-proxy-ip-10-0-136-148.ec2.internal\" (UID: \"3581e57e834108d06c1d0f1f0066af56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.328679 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.328679 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.328759 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.328759 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328741 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48dcebc81344d7e51f32d21eeaef298d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal\" (UID: \"48dcebc81344d7e51f32d21eeaef298d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.328829 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.328718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3581e57e834108d06c1d0f1f0066af56-config\") pod \"kube-apiserver-proxy-ip-10-0-136-148.ec2.internal\" (UID: \"3581e57e834108d06c1d0f1f0066af56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.423650 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:04.423603 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-148.ec2.internal\" not found" Jul 22 01:28:04.430283 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.430263 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:04.519902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.519827 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.529702 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.529680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.533819 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.533754 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.536634 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.536612 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:28:04.538064 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.538049 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" Jul 22 01:28:04.548079 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.548060 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:28:04.996067 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:04.995979 2561 apiserver.go:52] "Watching apiserver" Jul 22 01:28:05.004444 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.004417 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 01:28:05.004825 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.004802 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl","openshift-cluster-node-tuning-operator/tuned-zqkkp","openshift-dns/node-resolver-4cgmc","openshift-image-registry/node-ca-dbgqx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal","openshift-multus/network-metrics-daemon-q2qzp","kube-system/konnectivity-agent-g9cz4","openshift-multus/multus-6knr8","openshift-multus/multus-additional-cni-plugins-5lpjb","openshift-network-diagnostics/network-check-target-8qgpc","openshift-network-operator/iptables-alerter-xnv8f","openshift-ovn-kubernetes/ovnkube-node-m2q9k","kube-system/global-pull-secret-syncer-s68xt"] Jul 22 01:28:05.006575 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.006550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.008367 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.008347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.009137 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.009113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wrb6w\"" Jul 22 01:28:05.009426 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.009411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 01:28:05.009490 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.009475 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 01:28:05.009737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.009724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.010708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.010690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.010828 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.010814 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.010907 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.010817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 01:28:05.011161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.011146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.011360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.011324 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-998sh\"" Jul 22 01:28:05.012006 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.011989 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.012122 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.012104 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.012358 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.012345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gzgpn\"" Jul 22 01:28:05.012711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.012697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:05.012792 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.012760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:05.013428 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.013413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.013566 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.013551 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 01:28:05.013954 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.013939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.014075 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.014058 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 01:28:05.014152 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.014091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 01:28:05.014262 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.014246 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.014516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.014495 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 01:28:05.015011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.014687 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z9w8m\"" Jul 22 01:28:05.016988 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.016966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.017097 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.017054 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:05.017803 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.017744 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 01:28:05.017920 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.017906 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.018011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.017992 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.018079 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.018058 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 01:28:05.018302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.018281 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-89vjd\"" Jul 22 01:28:05.019252 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.019237 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 01:28:05.019337 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.019283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.021116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.021095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.021641 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.021555 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 01:28:05.021743 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.021652 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 01:28:05.021857 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.021802 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7k26\"" Jul 22 01:28:05.022788 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.022763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.023886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.023873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.024204 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024189 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 01:28:05.024204 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.024332 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024308 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-244z9\"" Jul 22 01:28:05.024397 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.024817 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024799 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-frnwp\"" Jul 22 01:28:05.024947 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.024932 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 01:28:05.025212 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.025199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.025500 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.025486 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.025782 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.025759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.025879 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.025844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:05.026687 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.026670 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 01:28:05.026946 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.026932 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-clm7z\"" Jul 22 01:28:05.027193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.027178 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 01:28:05.032000 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.031980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2940268-f222-4619-9cdf-6c9455ca6555-ovn-node-metrics-cert\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.032092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-conf\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-bin\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-host\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-serviceca\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-kubernetes\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-var-lib-kubelet\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-etc-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-bin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-multus-certs\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-lib-modules\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-slash\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-systemd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-device-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-kubelet\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-etc-kubernetes\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-kubelet\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-cni-binary-copy\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.032737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032741 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6lv5\" (UniqueName: \"kubernetes.io/projected/63c01fb4-c6fa-4409-be62-13a5a552ebab-kube-api-access-v6lv5\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-tmp\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032838 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-tuned\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-hostroot\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-run\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-multus\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c493b7b-cb77-4a29-996f-136de222324c-konnectivity-ca\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.032978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-socket-dir-parent\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-k8s-cni-cncf-io\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-ovn\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-netns\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfm9h\" (UniqueName: \"kubernetes.io/projected/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-kube-api-access-hfm9h\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-script-lib\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.033268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rfg\" (UniqueName: \"kubernetes.io/projected/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kube-api-access-c8rfg\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-daemon-config\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-cnibin\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-systemd\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033314 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-system-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-os-release\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7mp9\" (UniqueName: \"kubernetes.io/projected/d2940268-f222-4619-9cdf-6c9455ca6555-kube-api-access-r7mp9\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-conf-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57nt4\" (UniqueName: \"kubernetes.io/projected/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-kube-api-access-57nt4\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-cnibin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ns7\" (UniqueName: \"kubernetes.io/projected/ec6b471b-a4b3-4c50-9386-d800cb164487-kube-api-access-56ns7\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-var-lib-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-log-socket\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-env-overrides\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysconfig\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.034060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-sys\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-netns\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-config\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjfjg\" (UniqueName: \"kubernetes.io/projected/e081edff-bc8c-4edd-b64e-da291966cfd7-kube-api-access-gjfjg\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-system-cni-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-os-release\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-modprobe-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-node-log\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-netd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-systemd-units\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.033993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-host\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.034567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.034042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c493b7b-cb77-4a29-996f-136de222324c-agent-certs\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.035705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.035685 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:28:05.053369 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.053343 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nrfvf" Jul 22 01:28:05.062431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.062405 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nrfvf" Jul 22 01:28:05.121388 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.121349 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 01:28:05.133619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.133596 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:05.134174 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-serviceca\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.134265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.134265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-kubernetes\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-var-lib-kubelet\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-etc-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.134265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-bin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-multus-certs\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134292 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-kubernetes\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134307 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-var-lib-kubelet\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134310 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-etc-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-bin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-multus-certs\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-lib-modules\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-slash\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-systemd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-lib-modules\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134451 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggcc4\" (UniqueName: \"kubernetes.io/projected/674c0c68-2f16-4759-b432-bcf727612ae4-kube-api-access-ggcc4\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134489 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-systemd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.134525 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-slash\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-device-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-kubelet\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-etc-kubernetes\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-kubelet\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134628 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-device-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-kubelet\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-kubelet\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-etc-kubernetes\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-cni-binary-copy\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6lv5\" (UniqueName: \"kubernetes.io/projected/63c01fb4-c6fa-4409-be62-13a5a552ebab-kube-api-access-v6lv5\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134748 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-serviceca\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-tmp\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-tuned\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.135273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134869 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-hostroot\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-hostroot\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-run\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-multus\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134953 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c493b7b-cb77-4a29-996f-136de222324c-konnectivity-ca\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.134998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-socket-dir-parent\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135036 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-var-lib-cni-multus\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-run\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-k8s-cni-cncf-io\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135076 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135109 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-socket-dir-parent\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-ovn\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-k8s-cni-cncf-io\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-ovn\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.136144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-netns\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfm9h\" (UniqueName: \"kubernetes.io/projected/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-kube-api-access-hfm9h\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.135214 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-script-lib\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-dbus\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-host-run-netns\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.135284 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:05.63526368 +0000 UTC m=+3.689972311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rfg\" (UniqueName: \"kubernetes.io/projected/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kube-api-access-c8rfg\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135352 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-cni-binary-copy\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-daemon-config\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-cnibin\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-systemd\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrj7\" (UniqueName: \"kubernetes.io/projected/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-kube-api-access-nzrj7\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135550 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c493b7b-cb77-4a29-996f-136de222324c-konnectivity-ca\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-system-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137060 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135594 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-system-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-os-release\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7mp9\" (UniqueName: \"kubernetes.io/projected/d2940268-f222-4619-9cdf-6c9455ca6555-kube-api-access-r7mp9\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135628 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-cnibin\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-conf-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-systemd\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nt4\" (UniqueName: \"kubernetes.io/projected/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-kube-api-access-57nt4\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135716 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-conf-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-cnibin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ns7\" (UniqueName: \"kubernetes.io/projected/ec6b471b-a4b3-4c50-9386-d800cb164487-kube-api-access-56ns7\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135858 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-script-lib\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135869 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-os-release\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-var-lib-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135891 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-daemon-config\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.135995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-log-socket\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-var-lib-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136012 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-cnibin\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136112 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-log-socket\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.137902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-env-overrides\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysconfig\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysconfig\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-sys\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-netns\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136303 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-sys\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136331 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-run-netns\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-config\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjfjg\" (UniqueName: \"kubernetes.io/projected/e081edff-bc8c-4edd-b64e-da291966cfd7-kube-api-access-gjfjg\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-hosts-file\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-system-cni-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-os-release\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-env-overrides\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.138823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-modprobe-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-modprobe-d\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136497 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-os-release\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-node-log\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136628 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136644 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec6b471b-a4b3-4c50-9386-d800cb164487-system-cni-dir\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-netd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-systemd-units\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-node-log\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136685 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-netd\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-host\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-systemd-units\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136732 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-run-openvswitch\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c493b7b-cb77-4a29-996f-136de222324c-agent-certs\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136763 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-host\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2940268-f222-4619-9cdf-6c9455ca6555-ovn-node-metrics-cert\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.139710 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-tmp-dir\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2940268-f222-4619-9cdf-6c9455ca6555-ovnkube-config\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-conf\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-bin\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/674c0c68-2f16-4759-b432-bcf727612ae4-iptables-alerter-script\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/674c0c68-2f16-4759-b432-bcf727612ae4-host-slash\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-kubelet-config\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-host\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-host\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.136999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63c01fb4-c6fa-4409-be62-13a5a552ebab-multus-cni-dir\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137899 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-sysctl-conf\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140342 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.137944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2940268-f222-4619-9cdf-6c9455ca6555-host-cni-bin\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.140896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.138919 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec6b471b-a4b3-4c50-9386-d800cb164487-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.140896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.139120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-etc-tuned\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.139154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-tmp\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.140896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.139591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2940268-f222-4619-9cdf-6c9455ca6555-ovn-node-metrics-cert\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.140896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.139639 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c493b7b-cb77-4a29-996f-136de222324c-agent-certs\") pod \"konnectivity-agent-g9cz4\" (UID: \"0c493b7b-cb77-4a29-996f-136de222324c\") " pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.144212 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.144108 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:05.144212 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.144135 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:05.144212 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.144153 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:05.144436 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.144267 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:05.644221761 +0000 UTC m=+3.698930385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:05.145499 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.145471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57nt4\" (UniqueName: \"kubernetes.io/projected/92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39-kube-api-access-57nt4\") pod \"node-ca-dbgqx\" (UID: \"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39\") " pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.145589 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.145500 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfm9h\" (UniqueName: \"kubernetes.io/projected/a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7-kube-api-access-hfm9h\") pod \"tuned-zqkkp\" (UID: \"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7\") " pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.145589 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.145579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rfg\" (UniqueName: \"kubernetes.io/projected/c7c2fc58-14cb-48cd-843a-5ee4812d6bdd-kube-api-access-c8rfg\") pod \"aws-ebs-csi-driver-node-sbtpl\" (UID: \"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.146184 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.146157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ns7\" (UniqueName: \"kubernetes.io/projected/ec6b471b-a4b3-4c50-9386-d800cb164487-kube-api-access-56ns7\") pod \"multus-additional-cni-plugins-5lpjb\" (UID: \"ec6b471b-a4b3-4c50-9386-d800cb164487\") " pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.146262 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.146188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6lv5\" (UniqueName: \"kubernetes.io/projected/63c01fb4-c6fa-4409-be62-13a5a552ebab-kube-api-access-v6lv5\") pod \"multus-6knr8\" (UID: \"63c01fb4-c6fa-4409-be62-13a5a552ebab\") " pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.146959 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.146944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7mp9\" (UniqueName: \"kubernetes.io/projected/d2940268-f222-4619-9cdf-6c9455ca6555-kube-api-access-r7mp9\") pod \"ovnkube-node-m2q9k\" (UID: \"d2940268-f222-4619-9cdf-6c9455ca6555\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.147168 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.147148 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjfjg\" (UniqueName: \"kubernetes.io/projected/e081edff-bc8c-4edd-b64e-da291966cfd7-kube-api-access-gjfjg\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.238238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-hosts-file\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-tmp-dir\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238347 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-hosts-file\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.238413 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/674c0c68-2f16-4759-b432-bcf727612ae4-iptables-alerter-script\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.238468 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:05.738450091 +0000 UTC m=+3.793158698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:05.238508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/674c0c68-2f16-4759-b432-bcf727612ae4-host-slash\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-kubelet-config\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggcc4\" (UniqueName: \"kubernetes.io/projected/674c0c68-2f16-4759-b432-bcf727612ae4-kube-api-access-ggcc4\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-dbus\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238614 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-tmp-dir\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzrj7\" (UniqueName: \"kubernetes.io/projected/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-kube-api-access-nzrj7\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/674c0c68-2f16-4759-b432-bcf727612ae4-host-slash\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.238933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.238737 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-kubelet-config\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.239201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.239003 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/674c0c68-2f16-4759-b432-bcf727612ae4-iptables-alerter-script\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.239201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.239011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-dbus\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.250197 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.250138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggcc4\" (UniqueName: \"kubernetes.io/projected/674c0c68-2f16-4759-b432-bcf727612ae4-kube-api-access-ggcc4\") pod \"iptables-alerter-xnv8f\" (UID: \"674c0c68-2f16-4759-b432-bcf727612ae4\") " pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.250950 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.250929 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzrj7\" (UniqueName: \"kubernetes.io/projected/f558526b-1890-41cc-bfd8-9e0ec8b41d8c-kube-api-access-nzrj7\") pod \"node-resolver-4cgmc\" (UID: \"f558526b-1890-41cc-bfd8-9e0ec8b41d8c\") " pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.319548 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.319498 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dcebc81344d7e51f32d21eeaef298d.slice/crio-87b0bac63a9b29c7ef8d1263e891efed794e95b7ff2e2e4d807d53969c9c9920 WatchSource:0}: Error finding container 87b0bac63a9b29c7ef8d1263e891efed794e95b7ff2e2e4d807d53969c9c9920: Status 404 returned error can't find the container with id 87b0bac63a9b29c7ef8d1263e891efed794e95b7ff2e2e4d807d53969c9c9920 Jul 22 01:28:05.321314 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.321282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3581e57e834108d06c1d0f1f0066af56.slice/crio-89a17254953622dec17e60b05ce9dba27e07d0e20865d5dbf23c73ae02184cf9 WatchSource:0}: Error finding container 89a17254953622dec17e60b05ce9dba27e07d0e20865d5dbf23c73ae02184cf9: Status 404 returned error can't find the container with id 89a17254953622dec17e60b05ce9dba27e07d0e20865d5dbf23c73ae02184cf9 Jul 22 01:28:05.327939 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.327915 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:28:05.336971 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.336949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:05.344794 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.344755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c493b7b_cb77_4a29_996f_136de222324c.slice/crio-616307aae45717bea33240017faa32c6d2b41522637b165f52326dbeb3bb7863 WatchSource:0}: Error finding container 616307aae45717bea33240017faa32c6d2b41522637b165f52326dbeb3bb7863: Status 404 returned error can't find the container with id 616307aae45717bea33240017faa32c6d2b41522637b165f52326dbeb3bb7863 Jul 22 01:28:05.360391 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.360362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" Jul 22 01:28:05.367472 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.367445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" Jul 22 01:28:05.367813 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.367793 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c2fc58_14cb_48cd_843a_5ee4812d6bdd.slice/crio-a9d303384dfb3e9958dcd7dd59be52db4d19988c4670a9ed9a2c0a830d4eea54 WatchSource:0}: Error finding container a9d303384dfb3e9958dcd7dd59be52db4d19988c4670a9ed9a2c0a830d4eea54: Status 404 returned error can't find the container with id a9d303384dfb3e9958dcd7dd59be52db4d19988c4670a9ed9a2c0a830d4eea54 Jul 22 01:28:05.374827 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.374792 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87c82ce_1e09_4489_8f33_4fcaa7e1bcf7.slice/crio-3bb60296754ed925d5edd256adf26128f5279f82a579192b6dba7fbe48a9e0ae WatchSource:0}: Error finding container 3bb60296754ed925d5edd256adf26128f5279f82a579192b6dba7fbe48a9e0ae: Status 404 returned error can't find the container with id 3bb60296754ed925d5edd256adf26128f5279f82a579192b6dba7fbe48a9e0ae Jul 22 01:28:05.381101 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.381077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:05.390385 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.390362 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2940268_f222_4619_9cdf_6c9455ca6555.slice/crio-9f991181a08666a981a03276909b4687ab522794486eb125d82229835835b1b0 WatchSource:0}: Error finding container 9f991181a08666a981a03276909b4687ab522794486eb125d82229835835b1b0: Status 404 returned error can't find the container with id 9f991181a08666a981a03276909b4687ab522794486eb125d82229835835b1b0 Jul 22 01:28:05.419567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.419539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6knr8" Jul 22 01:28:05.427426 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.427401 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c01fb4_c6fa_4409_be62_13a5a552ebab.slice/crio-7b8c517a83b27cc9bb041958dd03436283a1bc25c0f2ecffb1492a94a45f0ca6 WatchSource:0}: Error finding container 7b8c517a83b27cc9bb041958dd03436283a1bc25c0f2ecffb1492a94a45f0ca6: Status 404 returned error can't find the container with id 7b8c517a83b27cc9bb041958dd03436283a1bc25c0f2ecffb1492a94a45f0ca6 Jul 22 01:28:05.428550 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.428531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" Jul 22 01:28:05.436687 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.436666 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6b471b_a4b3_4c50_9386_d800cb164487.slice/crio-469a6d95dc6c4638bf92d34bd91cc06d6888009f442d5f72c83fb0a88cb8932a WatchSource:0}: Error finding container 469a6d95dc6c4638bf92d34bd91cc06d6888009f442d5f72c83fb0a88cb8932a: Status 404 returned error can't find the container with id 469a6d95dc6c4638bf92d34bd91cc06d6888009f442d5f72c83fb0a88cb8932a Jul 22 01:28:05.439304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.439282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbgqx" Jul 22 01:28:05.448483 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.448463 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dd4b92_7dd8_4da8_aeb5_84bf13ccdb39.slice/crio-b36444899e7a5fd34900e3a361e4f20be7ccb5ff7c7a83ad86cc4c84ed71fe66 WatchSource:0}: Error finding container b36444899e7a5fd34900e3a361e4f20be7ccb5ff7c7a83ad86cc4c84ed71fe66: Status 404 returned error can't find the container with id b36444899e7a5fd34900e3a361e4f20be7ccb5ff7c7a83ad86cc4c84ed71fe66 Jul 22 01:28:05.474269 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.474242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xnv8f" Jul 22 01:28:05.477754 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.477727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cgmc" Jul 22 01:28:05.483621 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.483591 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674c0c68_2f16_4759_b432_bcf727612ae4.slice/crio-b38032325a8fef86640323fe843bb20bad6db7ad0b4802c5cd8135672c224943 WatchSource:0}: Error finding container b38032325a8fef86640323fe843bb20bad6db7ad0b4802c5cd8135672c224943: Status 404 returned error can't find the container with id b38032325a8fef86640323fe843bb20bad6db7ad0b4802c5cd8135672c224943 Jul 22 01:28:05.488246 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:05.488223 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf558526b_1890_41cc_bfd8_9e0ec8b41d8c.slice/crio-266a70837ad47107012d7e94c714346f22614214d89f8b3d71b890c666c18164 WatchSource:0}: Error finding container 266a70837ad47107012d7e94c714346f22614214d89f8b3d71b890c666c18164: Status 404 returned error can't find the container with id 266a70837ad47107012d7e94c714346f22614214d89f8b3d71b890c666c18164 Jul 22 01:28:05.490003 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.489979 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-4cgmc_openshift-dns(f558526b-1890-41cc-bfd8-9e0ec8b41d8c): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 22 01:28:05.490054 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.490024 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-4cgmc" podUID="f558526b-1890-41cc-bfd8-9e0ec8b41d8c" Jul 22 01:28:05.640809 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.640698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:05.640958 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.640847 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:05.640958 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.640917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.640895963 +0000 UTC m=+4.695604585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:05.741754 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.741715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:05.741936 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.741770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:05.741936 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.741893 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:05.742070 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.741960 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:05.742070 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.741982 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:05.742070 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.741993 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:05.742070 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.741965 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.741945124 +0000 UTC m=+4.796653747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:05.742070 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:05.742054 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.742037389 +0000 UTC m=+4.796745996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:05.881999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:05.881940 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:28:06.064916 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.064759 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:23:05 +0000 UTC" deadline="2028-02-05 23:20:52.992635262 +0000 UTC" Jul 22 01:28:06.064916 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.064838 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13533h52m46.92780144s" Jul 22 01:28:06.131289 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.130437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cgmc" event={"ID":"f558526b-1890-41cc-bfd8-9e0ec8b41d8c","Type":"ContainerStarted","Data":"266a70837ad47107012d7e94c714346f22614214d89f8b3d71b890c666c18164"} Jul 22 01:28:06.137112 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.137063 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83687a3e51e78c37199d4d4504faf8bfeec5d995d123db950ef57fe67957539\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-4cgmc" podUID="f558526b-1890-41cc-bfd8-9e0ec8b41d8c" Jul 22 01:28:06.155960 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.155874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xnv8f" event={"ID":"674c0c68-2f16-4759-b432-bcf727612ae4","Type":"ContainerStarted","Data":"b38032325a8fef86640323fe843bb20bad6db7ad0b4802c5cd8135672c224943"} Jul 22 01:28:06.169030 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.168996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerStarted","Data":"469a6d95dc6c4638bf92d34bd91cc06d6888009f442d5f72c83fb0a88cb8932a"} Jul 22 01:28:06.188811 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.188555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6knr8" event={"ID":"63c01fb4-c6fa-4409-be62-13a5a552ebab","Type":"ContainerStarted","Data":"7b8c517a83b27cc9bb041958dd03436283a1bc25c0f2ecffb1492a94a45f0ca6"} Jul 22 01:28:06.214603 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.214533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" event={"ID":"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7","Type":"ContainerStarted","Data":"3bb60296754ed925d5edd256adf26128f5279f82a579192b6dba7fbe48a9e0ae"} Jul 22 01:28:06.230397 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.230360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" event={"ID":"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd","Type":"ContainerStarted","Data":"a9d303384dfb3e9958dcd7dd59be52db4d19988c4670a9ed9a2c0a830d4eea54"} Jul 22 01:28:06.249280 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.249239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9cz4" event={"ID":"0c493b7b-cb77-4a29-996f-136de222324c","Type":"ContainerStarted","Data":"616307aae45717bea33240017faa32c6d2b41522637b165f52326dbeb3bb7863"} Jul 22 01:28:06.259642 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.259607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" event={"ID":"3581e57e834108d06c1d0f1f0066af56","Type":"ContainerStarted","Data":"89a17254953622dec17e60b05ce9dba27e07d0e20865d5dbf23c73ae02184cf9"} Jul 22 01:28:06.273404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.273369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbgqx" event={"ID":"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39","Type":"ContainerStarted","Data":"b36444899e7a5fd34900e3a361e4f20be7ccb5ff7c7a83ad86cc4c84ed71fe66"} Jul 22 01:28:06.280177 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.280145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"9f991181a08666a981a03276909b4687ab522794486eb125d82229835835b1b0"} Jul 22 01:28:06.303096 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.303026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" event={"ID":"48dcebc81344d7e51f32d21eeaef298d","Type":"ContainerStarted","Data":"87b0bac63a9b29c7ef8d1263e891efed794e95b7ff2e2e4d807d53969c9c9920"} Jul 22 01:28:06.651127 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.651061 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:06.651309 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.651280 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:08.651229412 +0000 UTC m=+6.705938035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:06.652115 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.652085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.753556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:06.753611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.753819 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.753840 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.753854 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.753916 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:08.753896564 +0000 UTC m=+6.808605176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.753989 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:06.754373 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:06.754026 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:08.75401468 +0000 UTC m=+6.808723302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:07.068903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:07.066000 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:23:05 +0000 UTC" deadline="2028-03-14 22:03:40.900976429 +0000 UTC" Jul 22 01:28:07.068903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:07.066041 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14444h35m33.834940239s" Jul 22 01:28:07.091526 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:07.091492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:07.091694 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:07.091654 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:07.091758 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:07.091738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:07.091931 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:07.091831 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:07.091931 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:07.091899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:07.092067 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:07.091979 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:08.670934 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:08.670890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:08.671473 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.671106 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:08.671473 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.671177 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:12.671155905 +0000 UTC m=+10.725864518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:08.771894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:08.771951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772159 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772179 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772193 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772253 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:12.772233652 +0000 UTC m=+10.826942274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772653 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:08.772739 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:08.772704 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:12.772687303 +0000 UTC m=+10.827395910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:09.091238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:09.091106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:09.091238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:09.091159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:09.091470 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:09.091248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:09.091470 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:09.091262 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:09.091470 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:09.091371 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:09.091470 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:09.091453 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:11.091143 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:11.091064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:11.091614 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:11.091255 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:11.091614 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:11.091296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:11.091614 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:11.091414 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:11.091614 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:11.091470 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:11.091614 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:11.091592 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:12.707233 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:12.707189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:12.707744 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.707343 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:12.707744 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.707419 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:20.707397451 +0000 UTC m=+18.762106083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:12.808246 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:12.808199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:12.808457 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:12.808261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:12.808457 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808380 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:12.808457 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808416 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:12.808457 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808435 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:12.808457 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808451 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:12.808720 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808467 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:20.808446553 +0000 UTC m=+18.863155175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:12.808720 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:12.808495 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:20.808482929 +0000 UTC m=+18.863191536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:13.091031 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:13.090938 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:13.091031 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:13.090972 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:13.091258 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:13.090939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:13.091258 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:13.091073 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:13.091258 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:13.091138 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:13.091258 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:13.091223 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:15.091454 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:15.090956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:15.091454 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:15.091089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:15.092027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:15.091483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:15.092027 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:15.091578 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:15.092027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:15.091609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:15.092027 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:15.091695 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:17.090745 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:17.090700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:17.090745 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:17.090747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:17.091235 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:17.091157 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:17.091309 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:17.091282 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:17.091399 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:17.091369 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:17.091536 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:17.091514 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:19.091182 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:19.091148 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:19.091588 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:19.091187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:19.091588 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:19.091255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:19.091588 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:19.091269 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:19.091588 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:19.091322 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:19.091588 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:19.091414 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:20.771313 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:20.771274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:20.771749 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.771414 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:20.771749 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.771483 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:36.771462773 +0000 UTC m=+34.826171378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:20.872065 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:20.872030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:20.872248 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:20.872075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:20.872248 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872187 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:20.872248 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872236 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:20.872391 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872253 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:20.872391 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872268 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:20.872391 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872255 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:36.872238723 +0000 UTC m=+34.926947329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:20.872391 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:20.872351 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:36.872328203 +0000 UTC m=+34.927036822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:21.091751 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:21.091658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:21.091751 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:21.091659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:21.091970 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:21.091786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:21.091970 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:21.091799 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:21.092050 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:21.091967 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:21.092050 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:21.092027 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:23.091110 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:23.091071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:23.091579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:23.091179 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:23.091579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:23.091190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:23.091579 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:23.091187 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:23.091579 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:23.091256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:23.091579 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:23.091370 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:25.091054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:25.091017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:25.091054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:25.091034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:25.091524 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:25.091123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:25.091524 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:25.091141 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:25.091524 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:25.091207 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:25.091524 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:25.091295 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:26.361131 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.360862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6knr8" event={"ID":"63c01fb4-c6fa-4409-be62-13a5a552ebab","Type":"ContainerStarted","Data":"0a142419a86042461ac0c21b4cc2cd6f8b6ea5c3a9b02169f03f44c459058c1a"} Jul 22 01:28:26.362370 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.362347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" event={"ID":"a87c82ce-1e09-4489-8f33-4fcaa7e1bcf7","Type":"ContainerStarted","Data":"1c5fa5d752095330674c847fd9dbc01cf565423ca72cb99580022e84146aee38"} Jul 22 01:28:26.363676 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.363651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" event={"ID":"3581e57e834108d06c1d0f1f0066af56","Type":"ContainerStarted","Data":"50c81d5b07fdf8e6990cb27f384c50efa4058e9adfcbcb43af407d4c21ad5322"} Jul 22 01:28:26.366114 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366096 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:28:26.366438 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366416 2561 generic.go:356] "Generic (PLEG): container finished" podID="d2940268-f222-4619-9cdf-6c9455ca6555" containerID="2bd08067d9e7de39001f1f0c32bbb2af34eeba96cb7b686e71f8b46bb32d2e5f" exitCode=1 Jul 22 01:28:26.366498 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"d6b248d26f61fabdfc5ae88808817d448952c674e4776c9f1379327516375b39"} Jul 22 01:28:26.366535 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"825f5064b9c5f0c898880cda1f019091884d3093f3d6da3bd866ec0dc917eb03"} Jul 22 01:28:26.366535 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"bc0790896c44c8391b1384935edd8aeba6eeaa6b8e57c3a6c9542d4814a49858"} Jul 22 01:28:26.366592 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerDied","Data":"2bd08067d9e7de39001f1f0c32bbb2af34eeba96cb7b686e71f8b46bb32d2e5f"} Jul 22 01:28:26.366592 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.366589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"439a0f808e4c54e61b2992064c276737ac5d8621dca292f3a58004be6a1c37b7"} Jul 22 01:28:26.382922 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.382869 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6knr8" podStartSLOduration=2.085234609 podStartE2EDuration="22.382851628s" totalImagesPullingTime="20.297617019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:26.381454764 +0000 UTC m=+24.436163393" watchObservedRunningTime="2026-07-22 01:28:26.382851628 +0000 UTC m=+24.437560255" Jul 22 01:28:26.396781 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.396717 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-148.ec2.internal" podStartSLOduration=21.396701703 podStartE2EDuration="21.396701703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:26.396299976 +0000 UTC m=+24.451008602" watchObservedRunningTime="2026-07-22 01:28:26.396701703 +0000 UTC m=+24.451410329" Jul 22 01:28:26.415328 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:26.415270 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqkkp" podStartSLOduration=2.065479226 podStartE2EDuration="22.415248348s" totalImagesPullingTime="20.349769122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:26.41421935 +0000 UTC m=+24.468927977" watchObservedRunningTime="2026-07-22 01:28:26.415248348 +0000 UTC m=+24.469957019" Jul 22 01:28:27.091659 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.091628 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:27.091814 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.091747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:27.091814 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:27.091777 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:27.091814 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.091787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:27.091946 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:27.091846 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:27.091946 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:27.091919 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:27.369479 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.369401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" event={"ID":"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd","Type":"ContainerStarted","Data":"e0c43ab2a5da0dfe5c62e8911d03eb3857d1a2e91e6542c8127ceda8dbadb163"} Jul 22 01:28:27.370807 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.370755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g9cz4" event={"ID":"0c493b7b-cb77-4a29-996f-136de222324c","Type":"ContainerStarted","Data":"fef15659cb0ccbbfcb0a6271de77ee2a62bde594f10f4e0d5f7658be9970586b"} Jul 22 01:28:27.372138 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.372107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbgqx" event={"ID":"92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39","Type":"ContainerStarted","Data":"71e2179940a536a4a828ec1fc839c090f32418e7dc20402149ad0fcd18934e4b"} Jul 22 01:28:27.374647 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.374627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:28:27.375039 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.375015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"d6aa951cd0e8f15b52acd76087a863eb1668af4a5f30fa46cdabc4ae7b2f80a9"} Jul 22 01:28:27.376345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.376326 2561 generic.go:356] "Generic (PLEG): container finished" podID="48dcebc81344d7e51f32d21eeaef298d" containerID="c1f4e540fc769b829c83156bba6c3162434cf70dde6a071a5a5c2f6a7eb7d072" exitCode=0 Jul 22 01:28:27.376441 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.376390 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" event={"ID":"48dcebc81344d7e51f32d21eeaef298d","Type":"ContainerDied","Data":"c1f4e540fc769b829c83156bba6c3162434cf70dde6a071a5a5c2f6a7eb7d072"} Jul 22 01:28:27.377748 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.377726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cgmc" event={"ID":"f558526b-1890-41cc-bfd8-9e0ec8b41d8c","Type":"ContainerStarted","Data":"545f0dbe60af9ae45c0b4db4cdef7d16ac76ed75f81f9dfec8d9ae46f948128a"} Jul 22 01:28:27.379126 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.379102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xnv8f" event={"ID":"674c0c68-2f16-4759-b432-bcf727612ae4","Type":"ContainerStarted","Data":"548221a4ab474b042112b9269360ce1b4f4c26757c993726f73ce6fda848461d"} Jul 22 01:28:27.380570 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.380544 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="72d2f8a00e54e892584cfcecc0abbc430fdc1c07178108f9fe062a1994fd5a8b" exitCode=0 Jul 22 01:28:27.380674 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.380620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"72d2f8a00e54e892584cfcecc0abbc430fdc1c07178108f9fe062a1994fd5a8b"} Jul 22 01:28:27.386559 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.386524 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g9cz4" podStartSLOduration=3.112268623 podStartE2EDuration="23.386512502s" totalImagesPullingTime="20.274243879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:27.386109509 +0000 UTC m=+25.440818135" watchObservedRunningTime="2026-07-22 01:28:27.386512502 +0000 UTC m=+25.441221108" Jul 22 01:28:27.400860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.400824 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xnv8f" podStartSLOduration=2.265070724 podStartE2EDuration="22.4008124s" totalImagesPullingTime="20.135741676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:27.40049246 +0000 UTC m=+25.455201087" watchObservedRunningTime="2026-07-22 01:28:27.4008124 +0000 UTC m=+25.455521026" Jul 22 01:28:27.415988 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.415632 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4cgmc" podStartSLOduration=22.415616034 podStartE2EDuration="22.415616034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-22 01:28:27.41505027 +0000 UTC m=+25.469758891" watchObservedRunningTime="2026-07-22 01:28:27.415616034 +0000 UTC m=+25.470324663" Jul 22 01:28:27.467977 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:27.467917 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dbgqx" podStartSLOduration=2.2873637110000002 podStartE2EDuration="22.467895683s" totalImagesPullingTime="20.180531972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:27.467338941 +0000 UTC m=+25.522047568" watchObservedRunningTime="2026-07-22 01:28:27.467895683 +0000 UTC m=+25.522604311" Jul 22 01:28:28.215490 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.215463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:28.325572 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.325547 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 01:28:28.384699 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.384666 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" event={"ID":"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd","Type":"ContainerStarted","Data":"48b79de40f8e60fb24d1a4ad6b916a2699024dbb03bb7d57951b92b7b3ed0cdc"} Jul 22 01:28:28.386654 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.386615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" event={"ID":"48dcebc81344d7e51f32d21eeaef298d","Type":"ContainerStarted","Data":"e483bd05984e06dea4eeeb2f336de70f22b69f1eebd7f6aca39764600c1187fe"} Jul 22 01:28:28.402063 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.402007 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-148.ec2.internal" podStartSLOduration=23.401994537 podStartE2EDuration="23.401994537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:28.401961808 +0000 UTC m=+26.456670437" watchObservedRunningTime="2026-07-22 01:28:28.401994537 +0000 UTC m=+26.456703163" Jul 22 01:28:28.451796 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.451749 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:28.553462 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.553378 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:28.780495 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.780468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:28.877080 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.876979 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:28.976990 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:28.976956 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:29.009596 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.009492 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T01:28:28.325569119Z","UUID":"0380ffd9-39b7-4d6c-ab87-769aead4c518","Handler":null,"Name":"","Endpoint":""} Jul 22 01:28:29.011547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.011526 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 01:28:29.011678 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.011567 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 01:28:29.090886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.090854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:29.090886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.090890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:29.091144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.090854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:29.091144 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:29.091002 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:29.091144 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:29.091123 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:29.091293 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:29.091206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:29.392194 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.392163 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:28:29.392801 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.392623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"b11b401c8b40d2d563ee419d2437a575999226fbbcd5b333972734869334e9f9"} Jul 22 01:28:29.846538 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.846510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:29.947255 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:29.947166 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:30.315296 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:30.315208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:30.398960 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:30.398921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" event={"ID":"c7c2fc58-14cb-48cd-843a-5ee4812d6bdd","Type":"ContainerStarted","Data":"25c5ab191b8a6803ebc671038a2a17bae21d8bea281c9c90c4679ec0e8001d13"} Jul 22 01:28:30.511651 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:30.511618 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:30.797835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:30.797748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:30.917565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:30.917529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:31.017045 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.017012 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:31.077114 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.077023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:31.091310 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.091283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:31.091310 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.091305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:31.091514 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.091309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:31.091514 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:31.091391 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:31.091514 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:31.091490 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:31.091668 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:31.091584 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:31.821045 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.821016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:31.922653 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:31.922482 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.024116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.024059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.271599 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.271570 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:32.272153 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.272136 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:32.290377 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.290337 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbtpl" podStartSLOduration=5.505274271 podStartE2EDuration="28.290322341s" totalImagesPullingTime="22.78504807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:30.420724539 +0000 UTC m=+28.475433166" watchObservedRunningTime="2026-07-22 01:28:32.290322341 +0000 UTC m=+30.345030965" Jul 22 01:28:32.320704 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.320665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.406512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.406453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:28:32.406847 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.406823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"1df428d4c8f25d60f9ece5b359e2c2508d2958eba7313ae50bfc3683519f7f0e"} Jul 22 01:28:32.407091 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.407072 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:32.407187 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.407145 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:32.407267 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.407256 2561 scope.go:117] "RemoveContainer" containerID="2bd08067d9e7de39001f1f0c32bbb2af34eeba96cb7b686e71f8b46bb32d2e5f" Jul 22 01:28:32.408712 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.408692 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="926ba0c4661acc48fc4d2d5f70f745520a824f4792bccc46f3726c0a7dafd53c" exitCode=0 Jul 22 01:28:32.408818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.408720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"926ba0c4661acc48fc4d2d5f70f745520a824f4792bccc46f3726c0a7dafd53c"} Jul 22 01:28:32.408989 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.408970 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:32.409385 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.409367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g9cz4" Jul 22 01:28:32.422147 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.422127 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:32.533584 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.533556 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.712359 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.712285 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.764016 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.763988 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:32.915276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:32.915242 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:33.090943 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.090856 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:33.090943 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.090898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:33.091172 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.090970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:33.091172 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:33.090988 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:33.091172 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:33.091098 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:33.091298 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:33.091190 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:33.413814 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.413731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:28:33.414110 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.414085 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" event={"ID":"d2940268-f222-4619-9cdf-6c9455ca6555","Type":"ContainerStarted","Data":"1edc4cb0d5d1c7c959a9a33055d00e5e94ee8da540cb8a8a987ff8c7c2a00e50"} Jul 22 01:28:33.414458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.414419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:33.428697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.428675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:28:33.442202 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.442159 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" podStartSLOduration=9.030607465 podStartE2EDuration="29.442144716s" totalImagesPullingTime="20.411537251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:33.441533567 +0000 UTC m=+31.496242194" watchObservedRunningTime="2026-07-22 01:28:33.442144716 +0000 UTC m=+31.496853321" Jul 22 01:28:33.759235 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:33.759208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.112749 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.112667 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.213066 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.213038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.268844 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.268817 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.323097 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.323073 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.418505 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.418436 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="badff41a06db83dde631fbc7d0fc8803d53b575948f9079ab3eaafe8fa372464" exitCode=0 Jul 22 01:28:34.418627 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.418516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"badff41a06db83dde631fbc7d0fc8803d53b575948f9079ab3eaafe8fa372464"} Jul 22 01:28:34.420897 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.420879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.522818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.522793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:34.913551 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:34.913444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:35.091557 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:35.091528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:35.091708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:35.091649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:35.091708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:35.091686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:35.091853 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:35.091658 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:35.091853 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:35.091750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:35.091853 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:35.091821 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:35.114176 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:35.114148 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:35.712455 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:35.712406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:36.109462 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.109292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:36.309135 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.309106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:36.425049 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.424976 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="00c464409c6ac462f7f49c6816aa2cf8148e28f9f77a5e0526e10579e28a77b4" exitCode=0 Jul 22 01:28:36.425193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.425042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"00c464409c6ac462f7f49c6816aa2cf8148e28f9f77a5e0526e10579e28a77b4"} Jul 22 01:28:36.709408 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.709328 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:36.793586 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.793559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:36.793742 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.793653 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:36.793742 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.793699 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs podName:e081edff-bc8c-4edd-b64e-da291966cfd7 nodeName:}" failed. No retries permitted until 2026-07-22 01:29:08.793686169 +0000 UTC m=+66.848394773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs") pod "network-metrics-daemon-q2qzp" (UID: "e081edff-bc8c-4edd-b64e-da291966cfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:28:36.894272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.894237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:36.894272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:36.894269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894367 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894376 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894392 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894402 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zmvkn for pod openshift-network-diagnostics/network-check-target-8qgpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894420 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret podName:daf4dc7f-305c-4a80-aea3-c50e8fc9dab0 nodeName:}" failed. No retries permitted until 2026-07-22 01:29:08.894405836 +0000 UTC m=+66.949114441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret") pod "global-pull-secret-syncer-s68xt" (UID: "daf4dc7f-305c-4a80-aea3-c50e8fc9dab0") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:28:36.894455 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:36.894441 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn podName:054454ab-4bea-4185-b70e-a7859eb97454 nodeName:}" failed. No retries permitted until 2026-07-22 01:29:08.894430998 +0000 UTC m=+66.949139603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmvkn" (UniqueName: "kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn") pod "network-check-target-8qgpc" (UID: "054454ab-4bea-4185-b70e-a7859eb97454") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:28:37.068717 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.068586 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:37.091003 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.090978 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:37.091160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.091013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:37.091160 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:37.091083 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:37.091160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.090978 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:37.091160 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:37.091144 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:37.091376 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:37.091219 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:37.510797 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.510704 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:37.712258 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.712192 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:37.912048 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:37.911973 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:38.310297 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:38.310213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:38.706724 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:38.706691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:38.909954 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:38.909907 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:39.090984 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:39.090943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:39.091165 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:39.090989 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:39.091165 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:39.090995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:39.091165 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:39.091104 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:39.091341 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:39.091163 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:39.091341 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:39.091254 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:41.090834 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:41.090802 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:41.090834 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:41.090830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:41.091261 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:41.090809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:41.091261 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:41.090922 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:41.091261 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:41.090981 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:41.091261 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:41.091051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:41.439608 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:41.439572 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="494f9e804b8542da13e34977252de26596b818f3461e912ecb07d9b5f1f7a3e1" exitCode=0 Jul 22 01:28:41.439777 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:41.439621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"494f9e804b8542da13e34977252de26596b818f3461e912ecb07d9b5f1f7a3e1"} Jul 22 01:28:42.444664 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:42.444634 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec6b471b-a4b3-4c50-9386-d800cb164487" containerID="d52cf017316ef527dc6cb2c818d0615592869b71ca0c86c6b6316f83d377a893" exitCode=0 Jul 22 01:28:42.445026 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:42.444692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerDied","Data":"d52cf017316ef527dc6cb2c818d0615592869b71ca0c86c6b6316f83d377a893"} Jul 22 01:28:42.670976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:42.670927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:42.770671 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:42.770573 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:43.091160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:43.091129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:43.091340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:43.091220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:43.091340 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:43.091323 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:43.091463 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:43.091219 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:43.091463 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:43.091223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:43.091463 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:43.091426 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:43.450287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:43.450209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" event={"ID":"ec6b471b-a4b3-4c50-9386-d800cb164487","Type":"ContainerStarted","Data":"059856dde09ade6c3b3a282e2b241edc63123e4a6d2d28478c73e810d5c353a7"} Jul 22 01:28:43.473005 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:43.472959 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5lpjb" podStartSLOduration=6.7191079689999995 podStartE2EDuration="38.472947124s" totalImagesPullingTime="31.753839155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:43.472783833 +0000 UTC m=+41.527492454" watchObservedRunningTime="2026-07-22 01:28:43.472947124 +0000 UTC m=+41.527655750" Jul 22 01:28:45.090919 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:45.090883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:45.091420 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:45.090981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:45.091420 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:45.090985 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:45.091420 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:45.091100 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:45.091420 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:45.091121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:45.091420 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:45.091180 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:47.091375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:47.091337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:47.091375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:47.091386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:47.091861 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:47.091456 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:47.091861 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:47.091486 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:47.091861 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:47.091559 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:47.091861 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:47.091617 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:48.741007 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:48.740963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:48.816909 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:48.816875 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:48.914327 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:48.914294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:49.011173 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.011092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:49.091113 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.091082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:49.091303 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.091204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:49.091303 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.091217 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:49.091427 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.091301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:49.091427 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.091342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:49.091427 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.091399 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:49.266940 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.266856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:49.321548 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.321513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:49.891934 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.891906 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qgpc"] Jul 22 01:28:49.892337 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.892000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:49.892337 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.892075 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:49.894647 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.894618 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s68xt"] Jul 22 01:28:49.894807 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.894713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:49.894897 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.894820 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:49.895397 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.895349 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q2qzp"] Jul 22 01:28:49.895521 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:49.895446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:49.895575 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:49.895535 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:50.235417 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:50.235382 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:50.290310 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:50.290279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:50.346650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:50.346624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:51.091690 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:51.091501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:51.092117 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:51.091500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:51.092117 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:51.091814 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:51.092117 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:51.091878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:52.091551 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:52.091517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:52.091713 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:52.091620 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:53.090694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:53.090671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:53.090854 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:53.090684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:53.090854 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:53.090791 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qgpc" podUID="054454ab-4bea-4185-b70e-a7859eb97454" Jul 22 01:28:53.090932 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:53.090862 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q2qzp" podUID="e081edff-bc8c-4edd-b64e-da291966cfd7" Jul 22 01:28:53.429773 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:53.429685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:53.484142 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:53.484079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:53.960135 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:53.960107 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:54.061181 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.061086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:54.092070 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.092040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:54.092212 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:28:54.092120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s68xt" podUID="daf4dc7f-305c-4a80-aea3-c50e8fc9dab0" Jul 22 01:28:54.144484 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.144455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:54.239070 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.239044 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-148.ec2.internal" event="NodeReady" Jul 22 01:28:54.239225 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.239175 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 01:28:54.281853 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.281818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cz9ft"] Jul 22 01:28:54.304248 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.304225 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9ctcr"] Jul 22 01:28:54.304407 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.304363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.307304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.307020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjdcf\"" Jul 22 01:28:54.307304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.307249 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 01:28:54.307475 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.307379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 01:28:54.322583 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.322555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b160-94a9-4335-a328-925a16bb93af-tmp-dir\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.322697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.322585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t48tn\" (UniqueName: \"kubernetes.io/projected/cac3b160-94a9-4335-a328-925a16bb93af-kube-api-access-t48tn\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.322697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.322605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cac3b160-94a9-4335-a328-925a16bb93af-config-volume\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.322697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.322626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cac3b160-94a9-4335-a328-925a16bb93af-metrics-tls\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.325380 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.325360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:54.326999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.326985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cz9ft"] Jul 22 01:28:54.327067 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.327021 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ctcr"] Jul 22 01:28:54.327067 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.327040 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tpbrp"] Jul 22 01:28:54.327135 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.327087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.331138 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.331119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m5cb9\"" Jul 22 01:28:54.331676 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.331634 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 01:28:54.332247 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.332046 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 01:28:54.332247 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.332080 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 01:28:54.347210 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.347190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tpbrp"] Jul 22 01:28:54.347329 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.347308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.349679 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.349659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 01:28:54.349818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.349659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 01:28:54.349818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.349786 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gdbrc\"" Jul 22 01:28:54.349818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.349809 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 01:28:54.349961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.349829 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 01:28:54.423757 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.423929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b160-94a9-4335-a328-925a16bb93af-tmp-dir\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.423929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423812 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t48tn\" (UniqueName: \"kubernetes.io/projected/cac3b160-94a9-4335-a328-925a16bb93af-kube-api-access-t48tn\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.423929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cac3b160-94a9-4335-a328-925a16bb93af-config-volume\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.423929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-cert\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.424059 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.423990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cac3b160-94a9-4335-a328-925a16bb93af-metrics-tls\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.424059 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.424131 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vr7\" (UniqueName: \"kubernetes.io/projected/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-api-access-d4vr7\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.424171 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-crio-socket\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.424212 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424171 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b160-94a9-4335-a328-925a16bb93af-tmp-dir\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.424212 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-data-volume\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.424308 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nczsp\" (UniqueName: \"kubernetes.io/projected/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-kube-api-access-nczsp\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.424439 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.424423 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cac3b160-94a9-4335-a328-925a16bb93af-config-volume\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.428033 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.428007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cac3b160-94a9-4335-a328-925a16bb93af-metrics-tls\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.428876 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.428856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:54.431968 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.431951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t48tn\" (UniqueName: \"kubernetes.io/projected/cac3b160-94a9-4335-a328-925a16bb93af-kube-api-access-t48tn\") pod \"dns-default-cz9ft\" (UID: \"cac3b160-94a9-4335-a328-925a16bb93af\") " pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.524974 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.524942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.524974 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.524977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vr7\" (UniqueName: \"kubernetes.io/projected/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-api-access-d4vr7\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-crio-socket\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-data-volume\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nczsp\" (UniqueName: \"kubernetes.io/projected/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-kube-api-access-nczsp\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.525201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525396 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-cert\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.525396 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-crio-socket\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525396 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-data-volume\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.525669 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.525649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.527403 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.527379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.527549 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.527532 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-cert\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.533648 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.533622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nczsp\" (UniqueName: \"kubernetes.io/projected/bcfcf477-5fcf-408c-bd7e-97cf0e9cb205-kube-api-access-nczsp\") pod \"ingress-canary-9ctcr\" (UID: \"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205\") " pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.533926 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.533911 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vr7\" (UniqueName: \"kubernetes.io/projected/0dfd5c12-833d-418e-9d43-d93a6ffbc6ac-kube-api-access-d4vr7\") pod \"insights-runtime-extractor-tpbrp\" (UID: \"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac\") " pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.614041 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.614006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cz9ft" Jul 22 01:28:54.635532 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.635503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9ctcr" Jul 22 01:28:54.655231 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.655205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tpbrp" Jul 22 01:28:54.826727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.826694 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9ctcr"] Jul 22 01:28:54.828165 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.828138 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cz9ft"] Jul 22 01:28:54.828577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:54.828552 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tpbrp"] Jul 22 01:28:54.836241 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:54.834237 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac3b160_94a9_4335_a328_925a16bb93af.slice/crio-47873231191f02d6a8178e225f9f75b719049a6365b660bdaf35b71f0170a63c WatchSource:0}: Error finding container 47873231191f02d6a8178e225f9f75b719049a6365b660bdaf35b71f0170a63c: Status 404 returned error can't find the container with id 47873231191f02d6a8178e225f9f75b719049a6365b660bdaf35b71f0170a63c Jul 22 01:28:54.836241 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:28:54.835487 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfcf477_5fcf_408c_bd7e_97cf0e9cb205.slice/crio-a42bedb40d1b4a52c407a109ded16a45dd10f09968a30a2082d31db9b8d99502 WatchSource:0}: Error finding container a42bedb40d1b4a52c407a109ded16a45dd10f09968a30a2082d31db9b8d99502: Status 404 returned error can't find the container with id a42bedb40d1b4a52c407a109ded16a45dd10f09968a30a2082d31db9b8d99502 Jul 22 01:28:55.091363 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.091330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:28:55.091363 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.091355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:28:55.095580 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.095410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l47xs\"" Jul 22 01:28:55.095795 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.095536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:28:55.095795 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.095668 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:28:55.095928 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.095916 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vpdlh\"" Jul 22 01:28:55.096320 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.096291 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:28:55.479805 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.479679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tpbrp" event={"ID":"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac","Type":"ContainerStarted","Data":"b94b457eb49431e84b235b8295adb4d2bd046a965f755e0b828b25f4100d628c"} Jul 22 01:28:55.481159 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.481118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ctcr" event={"ID":"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205","Type":"ContainerStarted","Data":"a42bedb40d1b4a52c407a109ded16a45dd10f09968a30a2082d31db9b8d99502"} Jul 22 01:28:55.486240 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.486208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cz9ft" event={"ID":"cac3b160-94a9-4335-a328-925a16bb93af","Type":"ContainerStarted","Data":"47873231191f02d6a8178e225f9f75b719049a6365b660bdaf35b71f0170a63c"} Jul 22 01:28:55.735670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.735427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:55.787866 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:55.787831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:56.091685 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:56.091654 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:28:56.105512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:56.105299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:28:59.552190 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:59.552162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:28:59.607080 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:28:59.607037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.287907 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.287828 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-8lxgj"] Jul 22 01:29:00.293943 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.293916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:00.296512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.296490 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 01:29:00.296623 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.296489 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 01:29:00.296623 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.296525 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gfqqb\"" Jul 22 01:29:00.298240 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.298212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.300432 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.300397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8lxgj"] Jul 22 01:29:00.373919 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.373886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kqrq\" (UniqueName: \"kubernetes.io/projected/4854143e-9cd8-4e7c-8532-3273931a06e1-kube-api-access-9kqrq\") pod \"downloads-5bc67dcd46-8lxgj\" (UID: \"4854143e-9cd8-4e7c-8532-3273931a06e1\") " pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:00.378728 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.378701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.475106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.475070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kqrq\" (UniqueName: \"kubernetes.io/projected/4854143e-9cd8-4e7c-8532-3273931a06e1-kube-api-access-9kqrq\") pod \"downloads-5bc67dcd46-8lxgj\" (UID: \"4854143e-9cd8-4e7c-8532-3273931a06e1\") " pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:00.485268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.485241 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kqrq\" (UniqueName: \"kubernetes.io/projected/4854143e-9cd8-4e7c-8532-3273931a06e1-kube-api-access-9kqrq\") pod \"downloads-5bc67dcd46-8lxgj\" (UID: \"4854143e-9cd8-4e7c-8532-3273931a06e1\") " pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:00.603892 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.603847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.605635 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.605611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:00.704110 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.704080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.795826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.795706 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8lxgj"] Jul 22 01:29:00.801305 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.801244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:00.804666 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:00.804613 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4854143e_9cd8_4e7c_8532_3273931a06e1.slice/crio-46e47e3fd1c97024f22fcf0717eebd70bbceeada5b8e6a891698d90e0ff17fb9 WatchSource:0}: Error finding container 46e47e3fd1c97024f22fcf0717eebd70bbceeada5b8e6a891698d90e0ff17fb9: Status 404 returned error can't find the container with id 46e47e3fd1c97024f22fcf0717eebd70bbceeada5b8e6a891698d90e0ff17fb9 Jul 22 01:29:00.858960 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:00.858898 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.167795 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.167693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.209397 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.209371 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4"] Jul 22 01:29:01.211615 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.211595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.214026 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214009 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 01:29:01.214189 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214047 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 01:29:01.214256 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214234 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 01:29:01.214319 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214266 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 01:29:01.214372 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214357 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 01:29:01.214948 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.214929 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kwgxr\"" Jul 22 01:29:01.223150 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.223124 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4"] Jul 22 01:29:01.230147 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.230123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.282466 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.282429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.282466 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.282469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbxn\" (UniqueName: \"kubernetes.io/projected/80913475-6d03-4565-9474-e44087346fed-kube-api-access-9wbxn\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.282703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.282502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.282703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.282606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80913475-6d03-4565-9474-e44087346fed-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.383850 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.383806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80913475-6d03-4565-9474-e44087346fed-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.384029 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.383882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.384029 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.383912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbxn\" (UniqueName: \"kubernetes.io/projected/80913475-6d03-4565-9474-e44087346fed-kube-api-access-9wbxn\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.384029 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.383939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.384182 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:01.384084 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 22 01:29:01.384182 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:01.384163 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls podName:80913475-6d03-4565-9474-e44087346fed nodeName:}" failed. No retries permitted until 2026-07-22 01:29:01.884143429 +0000 UTC m=+59.938852050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-qn9s4" (UID: "80913475-6d03-4565-9474-e44087346fed") : secret "prometheus-operator-tls" not found Jul 22 01:29:01.384705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.384679 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80913475-6d03-4565-9474-e44087346fed-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.386869 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.386820 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.398971 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.398927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbxn\" (UniqueName: \"kubernetes.io/projected/80913475-6d03-4565-9474-e44087346fed-kube-api-access-9wbxn\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.430952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.430868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.483905 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.483871 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.505595 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.505557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tpbrp" event={"ID":"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac","Type":"ContainerStarted","Data":"ff04173bca83510a8b13f1fe9300275229c818c35b0d62444600dba27f28c41e"} Jul 22 01:29:01.507822 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.507795 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9ctcr" event={"ID":"bcfcf477-5fcf-408c-bd7e-97cf0e9cb205","Type":"ContainerStarted","Data":"a45194e6ada10d53d009ddf12b5253577c15010248021e5e9da7427dce050cb3"} Jul 22 01:29:01.509235 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.509204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8lxgj" event={"ID":"4854143e-9cd8-4e7c-8532-3273931a06e1","Type":"ContainerStarted","Data":"46e47e3fd1c97024f22fcf0717eebd70bbceeada5b8e6a891698d90e0ff17fb9"} Jul 22 01:29:01.511471 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.511447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cz9ft" event={"ID":"cac3b160-94a9-4335-a328-925a16bb93af","Type":"ContainerStarted","Data":"c91822d916e9a0de83706e66d4ddc028716e6e4dda4f44bfa24e17e3fa22e443"} Jul 22 01:29:01.511568 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.511496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cz9ft" event={"ID":"cac3b160-94a9-4335-a328-925a16bb93af","Type":"ContainerStarted","Data":"ffc667739e4ead10ebaba0c299535dceafb806bb163e3c9e9e0feeb4aa7dec11"} Jul 22 01:29:01.511648 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.511625 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cz9ft" Jul 22 01:29:01.524724 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.524594 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9ctcr" podStartSLOduration=1.718127069 podStartE2EDuration="7.524576345s" totalImagesPullingTime="5.806449276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:01.524542737 +0000 UTC m=+59.579251366" watchObservedRunningTime="2026-07-22 01:29:01.524576345 +0000 UTC m=+59.579284975" Jul 22 01:29:01.541658 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.541594 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cz9ft" podStartSLOduration=1.737540691 podStartE2EDuration="7.541576079s" totalImagesPullingTime="5.804035388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:01.540271625 +0000 UTC m=+59.594980257" watchObservedRunningTime="2026-07-22 01:29:01.541576079 +0000 UTC m=+59.596284706" Jul 22 01:29:01.563833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.561127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.619618 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.619585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:01.888040 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.888003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.890773 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.890727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80913475-6d03-4565-9474-e44087346fed-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-qn9s4\" (UID: \"80913475-6d03-4565-9474-e44087346fed\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:01.907099 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:01.907063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:02.009264 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.009209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:02.121785 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.121723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" Jul 22 01:29:02.265229 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.265198 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4"] Jul 22 01:29:02.268436 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:02.268386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80913475_6d03_4565_9474_e44087346fed.slice/crio-94368922652c47f8ef820dc4ea7a8efd254632c2ea711ab6131ac593286fa5cb WatchSource:0}: Error finding container 94368922652c47f8ef820dc4ea7a8efd254632c2ea711ab6131ac593286fa5cb: Status 404 returned error can't find the container with id 94368922652c47f8ef820dc4ea7a8efd254632c2ea711ab6131ac593286fa5cb Jul 22 01:29:02.300255 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.300204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:02.401382 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.401292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:02.517133 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.517047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" event={"ID":"80913475-6d03-4565-9474-e44087346fed","Type":"ContainerStarted","Data":"94368922652c47f8ef820dc4ea7a8efd254632c2ea711ab6131ac593286fa5cb"} Jul 22 01:29:02.985653 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:02.985620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:03.038705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:03.038677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:04.801435 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.801350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:04.804274 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.804250 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.807009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.806981 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 01:29:04.807212 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.806981 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 01:29:04.808479 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.808286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 01:29:04.808479 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.808346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 01:29:04.808631 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.808614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b5jcb\"" Jul 22 01:29:04.808873 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.808856 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 01:29:04.814359 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.814332 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:04.913458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.913458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.913678 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.913678 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.913789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:04.913789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:04.913747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvh5s\" (UniqueName: \"kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014229 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014229 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh5s\" (UniqueName: \"kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.014516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.014339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.015055 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.015033 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.015155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.015072 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.015155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.015096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.016602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.016580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.016721 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.016701 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.023006 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.022988 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvh5s\" (UniqueName: \"kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s\") pod \"console-6fdc564d5d-6kcnk\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.116526 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.116469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:05.276080 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.276049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:05.365781 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:05.365736 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ad8fb7_c828_489e_baeb_4dcc395ea87e.slice/crio-175c1399ba56ded14de8b2e832182e395be02ce45c370d638de5c6c745191fa6 WatchSource:0}: Error finding container 175c1399ba56ded14de8b2e832182e395be02ce45c370d638de5c6c745191fa6: Status 404 returned error can't find the container with id 175c1399ba56ded14de8b2e832182e395be02ce45c370d638de5c6c745191fa6 Jul 22 01:29:05.438436 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.438410 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2q9k" Jul 22 01:29:05.528153 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.528020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tpbrp" event={"ID":"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac","Type":"ContainerStarted","Data":"b6e66e2a3c5a6169b0e7f3dd4808d25f87624d26bb1b099114e71c2091ec8cd6"} Jul 22 01:29:05.530063 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.529990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdc564d5d-6kcnk" event={"ID":"38ad8fb7-c828-489e-baeb-4dcc395ea87e","Type":"ContainerStarted","Data":"175c1399ba56ded14de8b2e832182e395be02ce45c370d638de5c6c745191fa6"} Jul 22 01:29:05.534205 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.534153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" event={"ID":"80913475-6d03-4565-9474-e44087346fed","Type":"ContainerStarted","Data":"0491087f459ed3669ba6ae03a660ea55e3bddfb65d9931afe2e7364b353394a2"} Jul 22 01:29:05.554205 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.554181 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:05.655146 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.655040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:05.757564 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:05.757520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:06.541412 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:06.541321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" event={"ID":"80913475-6d03-4565-9474-e44087346fed","Type":"ContainerStarted","Data":"12fecd6d2773fa619334f083b8a44d7e01e8d136abf9339e28ec2f28205b20ac"} Jul 22 01:29:06.561473 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:06.561416 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-qn9s4" podStartSLOduration=2.4434155730000002 podStartE2EDuration="5.561401741s" totalImagesPullingTime="3.117986168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:06.560146705 +0000 UTC m=+64.614855335" watchObservedRunningTime="2026-07-22 01:29:06.561401741 +0000 UTC m=+64.616110368" Jul 22 01:29:08.296375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.296293 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.417540 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.417497 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.521128 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.521089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.562626 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.562554 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m445w"] Jul 22 01:29:08.567961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.567931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.571301 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.571267 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7qdhf\"" Jul 22 01:29:08.571519 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.571497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 01:29:08.571629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.571570 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 01:29:08.571691 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.571509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 01:29:08.577604 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.577581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m445w"] Jul 22 01:29:08.597503 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.597470 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jjbbk"] Jul 22 01:29:08.601231 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.601204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.604089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.604068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 01:29:08.604089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.604076 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 01:29:08.604270 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.604133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 01:29:08.604270 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.604076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvrqr\"" Jul 22 01:29:08.613999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.613972 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.649427 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbwc\" (UniqueName: \"kubernetes.io/projected/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-api-access-9kbwc\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.649579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.649579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.649701 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.649701 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.649828 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.649708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bae6ecb7-80d7-4756-ace1-632ffb5175a6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.676133 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.676085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.750481 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-wtmp\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-sys\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-textfile\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-metrics-client-ca\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.750666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9wk\" (UniqueName: \"kubernetes.io/projected/d16fb160-09fa-415e-8f97-0773c287fa82-kube-api-access-7j9wk\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-root\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bae6ecb7-80d7-4756-ace1-632ffb5175a6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.751009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.750940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbwc\" (UniqueName: \"kubernetes.io/projected/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-api-access-9kbwc\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.751269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.751278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae6ecb7-80d7-4756-ace1-632ffb5175a6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.751400 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:08.751367 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 01:29:08.751553 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:08.751498 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls podName:bae6ecb7-80d7-4756-ace1-632ffb5175a6 nodeName:}" failed. No retries permitted until 2026-07-22 01:29:09.251484056 +0000 UTC m=+67.306192664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-m445w" (UID: "bae6ecb7-80d7-4756-ace1-632ffb5175a6") : secret "kube-state-metrics-tls" not found Jul 22 01:29:08.751952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.751928 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bae6ecb7-80d7-4756-ace1-632ffb5175a6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.754293 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.754082 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.764637 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.764611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbwc\" (UniqueName: \"kubernetes.io/projected/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-api-access-9kbwc\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:08.849146 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.849105 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.851614 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.851589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9wk\" (UniqueName: \"kubernetes.io/projected/d16fb160-09fa-415e-8f97-0773c287fa82-kube-api-access-7j9wk\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.851751 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.851637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.851841 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:08.851748 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 01:29:08.851893 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:08.851843 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls podName:d16fb160-09fa-415e-8f97-0773c287fa82 nodeName:}" failed. No retries permitted until 2026-07-22 01:29:09.3518218 +0000 UTC m=+67.406530411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls") pod "node-exporter-jjbbk" (UID: "d16fb160-09fa-415e-8f97-0773c287fa82") : secret "node-exporter-tls" not found Jul 22 01:29:08.851893 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.851882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-root\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.851998 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.851928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852046 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852004 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-root\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852102 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852153 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-wtmp\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852200 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-sys\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852250 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-textfile\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852250 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:29:08.852343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-metrics-client-ca\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-wtmp\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852291 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d16fb160-09fa-415e-8f97-0773c287fa82-sys\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852601 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-textfile\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-accelerators-collector-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.852840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.852818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16fb160-09fa-415e-8f97-0773c287fa82-metrics-client-ca\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.854542 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.854517 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:29:08.854707 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.854685 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.865120 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.865099 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e081edff-bc8c-4edd-b64e-da291966cfd7-metrics-certs\") pod \"network-metrics-daemon-q2qzp\" (UID: \"e081edff-bc8c-4edd-b64e-da291966cfd7\") " pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:29:08.866455 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.866428 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9wk\" (UniqueName: \"kubernetes.io/projected/d16fb160-09fa-415e-8f97-0773c287fa82-kube-api-access-7j9wk\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:08.904334 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.904299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l47xs\"" Jul 22 01:29:08.911534 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.911506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q2qzp" Jul 22 01:29:08.950305 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.950264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:08.953203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.953176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:29:08.953316 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.953273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:29:08.955711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.955572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:29:08.955711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.955583 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:29:08.965975 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.965948 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:29:08.966345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.966325 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/daf4dc7f-305c-4a80-aea3-c50e8fc9dab0-original-pull-secret\") pod \"global-pull-secret-syncer-s68xt\" (UID: \"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0\") " pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:29:08.976502 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:08.976470 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvkn\" (UniqueName: \"kubernetes.io/projected/054454ab-4bea-4185-b70e-a7859eb97454-kube-api-access-zmvkn\") pod \"network-check-target-8qgpc\" (UID: \"054454ab-4bea-4185-b70e-a7859eb97454\") " pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:29:09.004542 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.004507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s68xt" Jul 22 01:29:09.123472 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.123388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:09.208850 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.208812 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vpdlh\"" Jul 22 01:29:09.216240 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.216206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:29:09.241912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.241879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:09.256151 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.256112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:09.258970 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.258941 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bae6ecb7-80d7-4756-ace1-632ffb5175a6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m445w\" (UID: \"bae6ecb7-80d7-4756-ace1-632ffb5175a6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:09.357274 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.357230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:09.359826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.359803 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d16fb160-09fa-415e-8f97-0773c287fa82-node-exporter-tls\") pod \"node-exporter-jjbbk\" (UID: \"d16fb160-09fa-415e-8f97-0773c287fa82\") " pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:09.480387 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.480296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" Jul 22 01:29:09.512578 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.512545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jjbbk" Jul 22 01:29:09.533665 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.533631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:09.629959 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.629926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:09.915701 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:09.915669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:10.826208 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:10.826124 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q2qzp"] Jul 22 01:29:10.833721 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:10.833099 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode081edff_bc8c_4edd_b64e_da291966cfd7.slice/crio-f6c712096389fa4a607f41746f6480adb6c15088b8e14fe1dcad61c5f9983f01 WatchSource:0}: Error finding container f6c712096389fa4a607f41746f6480adb6c15088b8e14fe1dcad61c5f9983f01: Status 404 returned error can't find the container with id f6c712096389fa4a607f41746f6480adb6c15088b8e14fe1dcad61c5f9983f01 Jul 22 01:29:11.053314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.053235 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s68xt"] Jul 22 01:29:11.057476 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.057275 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qgpc"] Jul 22 01:29:11.058327 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.058256 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m445w"] Jul 22 01:29:11.059834 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:11.059809 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054454ab_4bea_4185_b70e_a7859eb97454.slice/crio-c8ff27043458b24edb6d7cf94389d4581da8ed27c4f2ee888048edffca6a7745 WatchSource:0}: Error finding container c8ff27043458b24edb6d7cf94389d4581da8ed27c4f2ee888048edffca6a7745: Status 404 returned error can't find the container with id c8ff27043458b24edb6d7cf94389d4581da8ed27c4f2ee888048edffca6a7745 Jul 22 01:29:11.061540 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:11.061516 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae6ecb7_80d7_4756_ace1_632ffb5175a6.slice/crio-7e610ac720449bf4d4f99a84be81dbd410ced0aea27dd957a02156cf77da73b1 WatchSource:0}: Error finding container 7e610ac720449bf4d4f99a84be81dbd410ced0aea27dd957a02156cf77da73b1: Status 404 returned error can't find the container with id 7e610ac720449bf4d4f99a84be81dbd410ced0aea27dd957a02156cf77da73b1 Jul 22 01:29:11.399110 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.399063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:11.500011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.499936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:11.520208 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.520180 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cz9ft" Jul 22 01:29:11.565791 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.564462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" event={"ID":"bae6ecb7-80d7-4756-ace1-632ffb5175a6","Type":"ContainerStarted","Data":"7e610ac720449bf4d4f99a84be81dbd410ced0aea27dd957a02156cf77da73b1"} Jul 22 01:29:11.566357 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.566321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2qzp" event={"ID":"e081edff-bc8c-4edd-b64e-da291966cfd7","Type":"ContainerStarted","Data":"f6c712096389fa4a607f41746f6480adb6c15088b8e14fe1dcad61c5f9983f01"} Jul 22 01:29:11.569431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.568967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tpbrp" event={"ID":"0dfd5c12-833d-418e-9d43-d93a6ffbc6ac","Type":"ContainerStarted","Data":"676c51166ac6573923fc2a08151637fa53c0d35912964b199d109d4c2d3af0ab"} Jul 22 01:29:11.570985 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.570957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qgpc" event={"ID":"054454ab-4bea-4185-b70e-a7859eb97454","Type":"ContainerStarted","Data":"c8ff27043458b24edb6d7cf94389d4581da8ed27c4f2ee888048edffca6a7745"} Jul 22 01:29:11.573692 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.573662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjbbk" event={"ID":"d16fb160-09fa-415e-8f97-0773c287fa82","Type":"ContainerStarted","Data":"1abc9c7ee33339fff8741297bfed70657b0489bf8bb71a9d51ca7f7e11e62430"} Jul 22 01:29:11.575141 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.575081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s68xt" event={"ID":"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0","Type":"ContainerStarted","Data":"b6cbc994f13e51d8e6aed42af2e5be58acba2918852f28e55847e25bda376754"} Jul 22 01:29:11.577391 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.577347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdc564d5d-6kcnk" event={"ID":"38ad8fb7-c828-489e-baeb-4dcc395ea87e","Type":"ContainerStarted","Data":"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e"} Jul 22 01:29:11.589655 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.589603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tpbrp" podStartSLOduration=1.99624895 podStartE2EDuration="17.589584009s" totalImagesPullingTime="15.593335059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:11.588549318 +0000 UTC m=+69.643257945" watchObservedRunningTime="2026-07-22 01:29:11.589584009 +0000 UTC m=+69.644292637" Jul 22 01:29:11.594083 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.594057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:11.606717 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.606672 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdc564d5d-6kcnk" podStartSLOduration=2.354190089 podStartE2EDuration="7.606654977s" totalImagesPullingTime="5.252464888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:11.605818783 +0000 UTC m=+69.660527411" watchObservedRunningTime="2026-07-22 01:29:11.606654977 +0000 UTC m=+69.661363593" Jul 22 01:29:11.666161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.665892 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c76b677f6-6s279"] Jul 22 01:29:11.669353 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.669329 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.672406 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672378 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 01:29:11.672552 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672438 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 01:29:11.672552 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672458 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 01:29:11.672552 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672540 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 01:29:11.672833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5jk3d0mekivrd\"" Jul 22 01:29:11.672833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672663 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qc5tb\"" Jul 22 01:29:11.672833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.672822 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 01:29:11.682055 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.682029 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c76b677f6-6s279"] Jul 22 01:29:11.757388 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.757355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:11.782497 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782497 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6b6\" (UniqueName: \"kubernetes.io/projected/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-kube-api-access-6k6b6\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782726 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782726 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782726 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-grpc-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782726 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-metrics-client-ca\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.782965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.782835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.810735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.810676 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:11.884027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.883967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6b6\" (UniqueName: \"kubernetes.io/projected/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-kube-api-access-6k6b6\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-grpc-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.884577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.884256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-metrics-client-ca\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.885306 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.885040 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-metrics-client-ca\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.887855 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.887793 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.888147 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.888120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.889508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.888920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.889508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.889400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.889508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.889468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-grpc-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.890911 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.890855 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-secret-thanos-querier-tls\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.893004 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.892963 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6b6\" (UniqueName: \"kubernetes.io/projected/8fb8dbe0-9f99-496e-a909-731bdd3f3b3f-kube-api-access-6k6b6\") pod \"thanos-querier-c76b677f6-6s279\" (UID: \"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f\") " pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:11.981912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:11.981608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:12.671192 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:12.671156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:12.772947 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:12.772906 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:13.292917 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:13.292879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:13.362733 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:13.362693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:13.877605 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:13.877561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:14.588179 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.588146 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:29:14.592739 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.590897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.601605 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.601577 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:29:14.602527 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.602502 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 01:29:14.710992 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.710959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bct8z\" (UniqueName: \"kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.711331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.711228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.763120 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.763082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:14.812546 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.812734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.812729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bct8z\" (UniqueName: \"kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.813411 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.813386 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.813539 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.813513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.813668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.813642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.814017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.813943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.815552 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.815524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.815667 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.815583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.821567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.821540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bct8z\" (UniqueName: \"kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z\") pod \"console-74c6f76f7d-hp4hn\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:14.829183 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.829157 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:14.904315 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:14.904207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:15.117694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.117659 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:15.117882 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.117727 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:15.123788 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.123753 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:15.486707 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.486665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:15.588683 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.588649 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:15.597851 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.597823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:15.689625 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:15.689572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:16.197660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:16.197620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:16.769132 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:16.769054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:16.838570 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:16.838536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:19.134186 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:19.134148 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:19.195880 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:19.195848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:20.397254 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:20.397130 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:20.497822 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:20.497781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:20.971528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:20.971417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c76b677f6-6s279"] Jul 22 01:29:20.993271 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:20.993199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:29:21.619404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:21.619363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjbbk" event={"ID":"d16fb160-09fa-415e-8f97-0773c287fa82","Type":"ContainerStarted","Data":"2755c9459774b3f5f1e448459bfade70f138537a473499be139896234d821cc1"} Jul 22 01:29:21.621352 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:21.621313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2qzp" event={"ID":"e081edff-bc8c-4edd-b64e-da291966cfd7","Type":"ContainerStarted","Data":"a3c351d608f408b898d1f6d7cabadfb82de8830b910b143d478431a31e8f511e"} Jul 22 01:29:22.316427 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.316391 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:22.429385 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.429342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:22.502337 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:22.502296 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb8dbe0_9f99_496e_a909_731bdd3f3b3f.slice/crio-c28065955ad453c9339c63d2dfc36319de4466d06bca65ddbcccec92e238b331 WatchSource:0}: Error finding container c28065955ad453c9339c63d2dfc36319de4466d06bca65ddbcccec92e238b331: Status 404 returned error can't find the container with id c28065955ad453c9339c63d2dfc36319de4466d06bca65ddbcccec92e238b331 Jul 22 01:29:22.502838 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:29:22.502818 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172ef9df_df61_4ab6_b6e9_f5b07d3b6516.slice/crio-31d5cd5243f2af3653ef9b524e5079727b0f4ec70efefc807bf73b196815fac6 WatchSource:0}: Error finding container 31d5cd5243f2af3653ef9b524e5079727b0f4ec70efefc807bf73b196815fac6: Status 404 returned error can't find the container with id 31d5cd5243f2af3653ef9b524e5079727b0f4ec70efefc807bf73b196815fac6 Jul 22 01:29:22.626195 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.626160 2561 generic.go:356] "Generic (PLEG): container finished" podID="d16fb160-09fa-415e-8f97-0773c287fa82" containerID="2755c9459774b3f5f1e448459bfade70f138537a473499be139896234d821cc1" exitCode=0 Jul 22 01:29:22.626660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.626250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjbbk" event={"ID":"d16fb160-09fa-415e-8f97-0773c287fa82","Type":"ContainerDied","Data":"2755c9459774b3f5f1e448459bfade70f138537a473499be139896234d821cc1"} Jul 22 01:29:22.627679 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.627658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c6f76f7d-hp4hn" event={"ID":"172ef9df-df61-4ab6-b6e9-f5b07d3b6516","Type":"ContainerStarted","Data":"31d5cd5243f2af3653ef9b524e5079727b0f4ec70efefc807bf73b196815fac6"} Jul 22 01:29:22.628961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:22.628938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"c28065955ad453c9339c63d2dfc36319de4466d06bca65ddbcccec92e238b331"} Jul 22 01:29:24.653504 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.653462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" event={"ID":"bae6ecb7-80d7-4756-ace1-632ffb5175a6","Type":"ContainerStarted","Data":"f344c8a7e2fb130769c506b5685e9f0d78238473f5a409ddc8136706e4145f30"} Jul 22 01:29:24.654208 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.654184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" event={"ID":"bae6ecb7-80d7-4756-ace1-632ffb5175a6","Type":"ContainerStarted","Data":"e9753c344f13fceab3467266258cf383dc8a9c09144796b46e106ed68b1cbd74"} Jul 22 01:29:24.654384 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.654365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" event={"ID":"bae6ecb7-80d7-4756-ace1-632ffb5175a6","Type":"ContainerStarted","Data":"75fd7f79db0bff635f8d9f4dcf5f1adef56e04ca57ce0245a2fc372587e532b2"} Jul 22 01:29:24.657054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.657029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q2qzp" event={"ID":"e081edff-bc8c-4edd-b64e-da291966cfd7","Type":"ContainerStarted","Data":"20590ac5eee0f4779e23f2e1df35e480e374794ea43d77dbef3f992af593b75c"} Jul 22 01:29:24.659338 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.659319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8lxgj" event={"ID":"4854143e-9cd8-4e7c-8532-3273931a06e1","Type":"ContainerStarted","Data":"eb81b23260efd2b86c26276f308af6870656c781b677398672fcde20fdd05b76"} Jul 22 01:29:24.660301 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.660287 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:24.668015 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.667986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qgpc" event={"ID":"054454ab-4bea-4185-b70e-a7859eb97454","Type":"ContainerStarted","Data":"43705c149a6cc6f3e5d720804b0bd7d84727f1f4d350d896af8bbde55fd420d1"} Jul 22 01:29:24.668236 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.668222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:29:24.671161 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.671138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjbbk" event={"ID":"d16fb160-09fa-415e-8f97-0773c287fa82","Type":"ContainerStarted","Data":"e44cffe15b8baab9ed48758aa89a4520960a803acaf70d1e17d7ae680466149c"} Jul 22 01:29:24.671334 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.671316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jjbbk" event={"ID":"d16fb160-09fa-415e-8f97-0773c287fa82","Type":"ContainerStarted","Data":"40939ee2e86b7e66d64b6c2f6284919a72da2581028a577a7a6a0f66e2b2eb3f"} Jul 22 01:29:24.673804 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.673747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-8lxgj" Jul 22 01:29:24.673959 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.673936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s68xt" event={"ID":"daf4dc7f-305c-4a80-aea3-c50e8fc9dab0","Type":"ContainerStarted","Data":"c9dc67f105b7b0ea6c19c82b9f41b44269a929df6e68df67e14841cbe00b5692"} Jul 22 01:29:24.677816 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.677792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c6f76f7d-hp4hn" event={"ID":"172ef9df-df61-4ab6-b6e9-f5b07d3b6516","Type":"ContainerStarted","Data":"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15"} Jul 22 01:29:24.693700 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.693646 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-m445w" podStartSLOduration=3.914831455 podStartE2EDuration="16.693626389s" totalImagesPullingTime="12.778794934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.676910818 +0000 UTC m=+82.731619445" watchObservedRunningTime="2026-07-22 01:29:24.693626389 +0000 UTC m=+82.748335017" Jul 22 01:29:24.712365 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.712314 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s68xt" podStartSLOduration=66.883913705 podStartE2EDuration="1m19.712290512s" totalImagesPullingTime="12.828376807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.694073366 +0000 UTC m=+82.748781993" watchObservedRunningTime="2026-07-22 01:29:24.712290512 +0000 UTC m=+82.766999142" Jul 22 01:29:24.713918 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.713875 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-8lxgj" podStartSLOduration=4.651764643 podStartE2EDuration="24.713852679s" totalImagesPullingTime="20.062088036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.712138216 +0000 UTC m=+82.766846844" watchObservedRunningTime="2026-07-22 01:29:24.713852679 +0000 UTC m=+82.768561308" Jul 22 01:29:24.740777 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.740716 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jjbbk" podStartSLOduration=6.50868898 podStartE2EDuration="16.740694755s" totalImagesPullingTime="10.145700386s" totalInitContainerRuntime="86.305389ms" isStatefulPod=true podCreationTimestamp="2026-07-22 01:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.739214243 +0000 UTC m=+82.793922871" watchObservedRunningTime="2026-07-22 01:29:24.740694755 +0000 UTC m=+82.795403382" Jul 22 01:29:24.760955 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.760403 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8qgpc" podStartSLOduration=67.925842996 podStartE2EDuration="1m20.760380035s" totalImagesPullingTime="12.834537039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.759823339 +0000 UTC m=+82.814531967" watchObservedRunningTime="2026-07-22 01:29:24.760380035 +0000 UTC m=+82.815088663" Jul 22 01:29:24.778693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.778182 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q2qzp" podStartSLOduration=69.816480483 podStartE2EDuration="1m19.778159212s" totalImagesPullingTime="9.961678729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.777044488 +0000 UTC m=+82.831753115" watchObservedRunningTime="2026-07-22 01:29:24.778159212 +0000 UTC m=+82.832867841" Jul 22 01:29:24.796650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.796592 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c6f76f7d-hp4hn" podStartSLOduration=10.796569105 podStartE2EDuration="10.796569105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:24.795814234 +0000 UTC m=+82.850522860" watchObservedRunningTime="2026-07-22 01:29:24.796569105 +0000 UTC m=+82.851277733" Jul 22 01:29:24.902496 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.902461 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:24.904570 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.904499 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:24.904570 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.904560 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:24.912352 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.912321 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:24.996115 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:24.996077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:25.689592 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:25.689561 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:29:25.743996 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:25.743959 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:25.863281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:25.863188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:25.964026 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:25.963954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:26.690441 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:26.690392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"902c880a571c77d75f5264b59d29d52acf3cc78b982fa88114bab7a1a14097a4"} Jul 22 01:29:26.690946 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:26.690502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"78ac19c2d9a42b39bf37f8d7da5e289ce93c7ee3b400348a27e1613f0c464267"} Jul 22 01:29:26.690946 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:26.690543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"2ced8939402f158ddc262e787fbda7d556f412ae37d35a24be453a531f6e2e2c"} Jul 22 01:29:27.671469 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:27.671430 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:27.733488 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:27.733453 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:28.702376 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:28.702324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"df76ee09d59b1ed957c7af8a95277f4da0faee4f41b7c5b571efab1baa98a5c3"} Jul 22 01:29:28.702565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:28.702412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"e7328760472a2a7c587449440e5853e0a0bb7aaa4ca768e341bb4999bff4f053"} Jul 22 01:29:28.702565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:28.702453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" event={"ID":"8fb8dbe0-9f99-496e-a909-731bdd3f3b3f","Type":"ContainerStarted","Data":"29bc21edad4389b4d447f94b15cd3f4aa0685aa5da4a029ef62560de794f19ad"} Jul 22 01:29:28.702565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:28.702546 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:28.726565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:28.726481 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" podStartSLOduration=12.812549099 podStartE2EDuration="17.726462203s" totalImagesPullingTime="4.913913104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:29:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:28.724974485 +0000 UTC m=+86.779683124" watchObservedRunningTime="2026-07-22 01:29:28.726462203 +0000 UTC m=+86.781170832" Jul 22 01:29:29.199296 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:29.199254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:29.314803 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:29.314747 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:34.216934 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:34.216893 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:34.321988 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:34.321941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:34.376836 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:34.376807 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:34.712835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:34.712808 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c76b677f6-6s279" Jul 22 01:29:42.799172 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:42.799135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:42.852595 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:42.852568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:29:50.772745 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:50.772704 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fdc564d5d-6kcnk" podUID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" containerName="console" containerID="cri-o://7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e" gracePeriod=15 Jul 22 01:29:51.046907 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.046838 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:51.106458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106429 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106467 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvh5s\" (UniqueName: \"kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106492 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106528 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106555 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106616 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert\") pod \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\" (UID: \"38ad8fb7-c828-489e-baeb-4dcc395ea87e\") " Jul 22 01:29:51.106968 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106939 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca" (OuterVolumeSpecName: "service-ca") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:29:51.106968 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.106944 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:29:51.107137 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.107023 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config" (OuterVolumeSpecName: "console-config") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:29:51.108888 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.108857 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:29:51.108969 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.108902 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s" (OuterVolumeSpecName: "kube-api-access-xvh5s") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "kube-api-access-xvh5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:29:51.108969 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.108953 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38ad8fb7-c828-489e-baeb-4dcc395ea87e" (UID: "38ad8fb7-c828-489e-baeb-4dcc395ea87e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:29:51.207400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207371 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.207400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207396 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.207400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207405 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-oauth-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.207600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207414 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvh5s\" (UniqueName: \"kubernetes.io/projected/38ad8fb7-c828-489e-baeb-4dcc395ea87e-kube-api-access-xvh5s\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.207600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207423 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ad8fb7-c828-489e-baeb-4dcc395ea87e-console-oauth-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.207600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.207431 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ad8fb7-c828-489e-baeb-4dcc395ea87e-service-ca\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:29:51.787435 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.787397 2561 generic.go:356] "Generic (PLEG): container finished" podID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" containerID="7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e" exitCode=0 Jul 22 01:29:51.787860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.787445 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdc564d5d-6kcnk" Jul 22 01:29:51.787860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.787477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdc564d5d-6kcnk" event={"ID":"38ad8fb7-c828-489e-baeb-4dcc395ea87e","Type":"ContainerDied","Data":"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e"} Jul 22 01:29:51.787860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.787525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdc564d5d-6kcnk" event={"ID":"38ad8fb7-c828-489e-baeb-4dcc395ea87e","Type":"ContainerDied","Data":"175c1399ba56ded14de8b2e832182e395be02ce45c370d638de5c6c745191fa6"} Jul 22 01:29:51.787860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.787544 2561 scope.go:117] "RemoveContainer" containerID="7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e" Jul 22 01:29:51.795832 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.795810 2561 scope.go:117] "RemoveContainer" containerID="7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e" Jul 22 01:29:51.796090 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:29:51.796071 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e\": container with ID starting with 7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e not found: ID does not exist" containerID="7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e" Jul 22 01:29:51.796160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.796102 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e"} err="failed to get container status \"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e\": rpc error: code = NotFound desc = could not find container \"7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e\": container with ID starting with 7bd347f30d946dbcae00c80578bb92328764d914fc334ca30d96dd8efae2019e not found: ID does not exist" Jul 22 01:29:51.808956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.808934 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:51.812928 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:51.812899 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdc564d5d-6kcnk"] Jul 22 01:29:52.095377 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:52.095345 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" path="/var/lib/kubelet/pods/38ad8fb7-c828-489e-baeb-4dcc395ea87e/volumes" Jul 22 01:29:56.694546 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:29:56.693674 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8qgpc" Jul 22 01:30:27.850675 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:27.850638 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:28.518111 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:28.518078 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:30.847034 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.846997 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:30:30.847453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.847261 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" containerName="console" Jul 22 01:30:30.847453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.847273 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" containerName="console" Jul 22 01:30:30.847453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.847317 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ad8fb7-c828-489e-baeb-4dcc395ea87e" containerName="console" Jul 22 01:30:30.850383 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.850361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.856140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 01:30:30.856275 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 01:30:30.856965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 01:30:30.856965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p2rsp\"" Jul 22 01:30:30.856965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856579 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 01:30:30.856965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.856724 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 01:30:30.857200 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.857180 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 01:30:30.857270 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.857180 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 01:30:30.859110 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.858946 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 01:30:30.864358 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.864323 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 01:30:30.872133 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.872109 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:30:30.913734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tcqt\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-kube-api-access-4tcqt\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-web-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.913952 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.914140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.914140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.913988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-out\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.914140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.914034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.914140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.914052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-volume\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:30.914140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:30.914068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015114 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-volume\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015114 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tcqt\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-kube-api-access-4tcqt\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-web-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015696 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015696 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-out\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.015696 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.015449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.016106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.016078 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.016555 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.016530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.016695 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.016530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.018387 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.018356 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.018617 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.018575 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-out\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.018936 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.018887 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-config-volume\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.019039 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.018969 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.019039 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.018998 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.019314 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.019295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.019372 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.019355 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.019524 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.019499 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-web-config\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.020013 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.019994 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a443ed9e-2c47-4ddb-9706-d1bc27766653-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.024999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.024979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tcqt\" (UniqueName: \"kubernetes.io/projected/a443ed9e-2c47-4ddb-9706-d1bc27766653-kube-api-access-4tcqt\") pod \"alertmanager-main-0\" (UID: \"a443ed9e-2c47-4ddb-9706-d1bc27766653\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.160168 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.160082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:30:31.295473 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.295439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:30:31.298561 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:30:31.298535 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda443ed9e_2c47_4ddb_9706_d1bc27766653.slice/crio-406a8c9cacea4268d3d631eb294a7fc4c2762115ec9e12a56ba44ac9536b1575 WatchSource:0}: Error finding container 406a8c9cacea4268d3d631eb294a7fc4c2762115ec9e12a56ba44ac9536b1575: Status 404 returned error can't find the container with id 406a8c9cacea4268d3d631eb294a7fc4c2762115ec9e12a56ba44ac9536b1575 Jul 22 01:30:31.937059 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:31.937022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"406a8c9cacea4268d3d631eb294a7fc4c2762115ec9e12a56ba44ac9536b1575"} Jul 22 01:30:32.950070 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.950033 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68849f849c-jssv7"] Jul 22 01:30:32.954244 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.954219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:32.957088 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957065 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 01:30:32.957216 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957184 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 01:30:32.957332 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957317 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 01:30:32.957619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 01:30:32.957677 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 01:30:32.957928 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.957909 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2lv7t\"" Jul 22 01:30:32.967167 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.967143 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68849f849c-jssv7"] Jul 22 01:30:32.970965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:32.970941 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 01:30:33.031618 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqwr8\" (UniqueName: \"kubernetes.io/projected/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-kube-api-access-dqwr8\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-metrics-client-ca\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-serving-certs-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.031789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.031755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-federate-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.132851 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.132742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.132851 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.132797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqwr8\" (UniqueName: \"kubernetes.io/projected/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-kube-api-access-dqwr8\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.132914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.132956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-metrics-client-ca\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.133038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.133070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-serving-certs-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133332 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.133137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-federate-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133537 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.133509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.133819 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.133791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-metrics-client-ca\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.134133 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.134090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.134461 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.134436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-serving-certs-ca-bundle\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.136101 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.136059 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-federate-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.136948 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.136924 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.137029 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.136970 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-telemeter-client-tls\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.137108 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.137089 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-secret-telemeter-client\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.142226 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.142206 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqwr8\" (UniqueName: \"kubernetes.io/projected/b7e1e998-52c3-463c-b4ff-91b8950f9a9b-kube-api-access-dqwr8\") pod \"telemeter-client-68849f849c-jssv7\" (UID: \"b7e1e998-52c3-463c-b4ff-91b8950f9a9b\") " pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.266576 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.266541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" Jul 22 01:30:33.423233 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.423144 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68849f849c-jssv7"] Jul 22 01:30:33.427012 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:30:33.426970 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e1e998_52c3_463c_b4ff_91b8950f9a9b.slice/crio-d7d96a163928887065d12493277de6da025ef91447570665d0f72e7d97b07d0d WatchSource:0}: Error finding container d7d96a163928887065d12493277de6da025ef91447570665d0f72e7d97b07d0d: Status 404 returned error can't find the container with id d7d96a163928887065d12493277de6da025ef91447570665d0f72e7d97b07d0d Jul 22 01:30:33.957076 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.957038 2561 generic.go:356] "Generic (PLEG): container finished" podID="a443ed9e-2c47-4ddb-9706-d1bc27766653" containerID="1c87e94b5b36a4fdf2df8c9ba18212e467c1ae1c5cbc77aa9dfba6036301c965" exitCode=0 Jul 22 01:30:33.957533 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.957118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerDied","Data":"1c87e94b5b36a4fdf2df8c9ba18212e467c1ae1c5cbc77aa9dfba6036301c965"} Jul 22 01:30:33.958363 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:33.958338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" event={"ID":"b7e1e998-52c3-463c-b4ff-91b8950f9a9b","Type":"ContainerStarted","Data":"d7d96a163928887065d12493277de6da025ef91447570665d0f72e7d97b07d0d"} Jul 22 01:30:36.973011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.972973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"cd02010daeb84e5e87b98a410830568e1ddb8f2b2410e40c78fe815d1934bbec"} Jul 22 01:30:36.973431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.973054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"c217bfa53458c7049179b45dd2883c40bdae0895d052d6261c05f89a68c6cd12"} Jul 22 01:30:36.973431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.973087 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"20391c856310fb3efefe33f5a84fc9c9132d1b4e40afcd585678b76f6125b1d0"} Jul 22 01:30:36.973431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.973126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"205867bad7492dd16d75a4267d3ef00ff3ae6acb74d037e0162fe510b2a407f3"} Jul 22 01:30:36.973431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.973152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"334224ba0d8fc112b0497ca758846aeab4f24d9c72a70ecebbdcdff99a603c09"} Jul 22 01:30:36.973431 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.973183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a443ed9e-2c47-4ddb-9706-d1bc27766653","Type":"ContainerStarted","Data":"cb77d91665993c9e2a9b43490b15f19d12dc764106764b68db8cd39f63749b97"} Jul 22 01:30:36.975009 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.974981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" event={"ID":"b7e1e998-52c3-463c-b4ff-91b8950f9a9b","Type":"ContainerStarted","Data":"31cb7a6bf4cbcf63e20329abf7beb1bb6004bc607dee4428cf238d7a9f0e22a2"} Jul 22 01:30:36.975121 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.975038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" event={"ID":"b7e1e998-52c3-463c-b4ff-91b8950f9a9b","Type":"ContainerStarted","Data":"981430bb6dcaf4719540178906cfcb13f41430f94a44fe8cd49f1c3717677156"} Jul 22 01:30:36.975121 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:36.975058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" event={"ID":"b7e1e998-52c3-463c-b4ff-91b8950f9a9b","Type":"ContainerStarted","Data":"e1da5d43ca1e2648b90fb866f98ab4e1377c6ce8e7d815a702014a4f5850fad7"} Jul 22 01:30:37.008240 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:37.008190 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.469468177 podStartE2EDuration="7.008174393s" totalImagesPullingTime="3.517078891s" totalInitContainerRuntime="21.627325ms" isStatefulPod=false podCreationTimestamp="2026-07-22 01:30:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:30:37.007293547 +0000 UTC m=+155.062002174" watchObservedRunningTime="2026-07-22 01:30:37.008174393 +0000 UTC m=+155.062883020" Jul 22 01:30:37.035013 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:37.034957 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68849f849c-jssv7" podStartSLOduration=2.548578396 podStartE2EDuration="5.03494053s" totalImagesPullingTime="2.486362134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:30:37.033288875 +0000 UTC m=+155.087997503" watchObservedRunningTime="2026-07-22 01:30:37.03494053 +0000 UTC m=+155.089649157" Jul 22 01:30:38.100681 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.100652 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:30:38.102793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.102775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.121646 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.121620 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:30:38.180191 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwsvt\" (UniqueName: \"kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180474 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.180514 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.180495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.281599 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.281815 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.281894 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.281894 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwsvt\" (UniqueName: \"kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.281988 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282048 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.281981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282100 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.282051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282614 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.282586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.282585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282858 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.282838 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.282981 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.282960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.284835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.284807 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.284925 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.284903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.290603 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.290575 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:38.297478 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.297458 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwsvt\" (UniqueName: \"kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt\") pod \"console-84f8dd5b5b-k54sg\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.412517 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.412422 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:38.559116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.559070 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:30:38.561084 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:30:38.561057 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8f1b2d_8017_4960_ab7d_dc3c47eee817.slice/crio-141e66d665110478aee73a8251d0684994747a2f3da89c87c731bef99627491d WatchSource:0}: Error finding container 141e66d665110478aee73a8251d0684994747a2f3da89c87c731bef99627491d: Status 404 returned error can't find the container with id 141e66d665110478aee73a8251d0684994747a2f3da89c87c731bef99627491d Jul 22 01:30:38.985555 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.985520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f8dd5b5b-k54sg" event={"ID":"5d8f1b2d-8017-4960-ab7d-dc3c47eee817","Type":"ContainerStarted","Data":"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66"} Jul 22 01:30:38.985698 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:38.985573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f8dd5b5b-k54sg" event={"ID":"5d8f1b2d-8017-4960-ab7d-dc3c47eee817","Type":"ContainerStarted","Data":"141e66d665110478aee73a8251d0684994747a2f3da89c87c731bef99627491d"} Jul 22 01:30:39.005790 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:39.005733 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f8dd5b5b-k54sg" podStartSLOduration=1.005717061 podStartE2EDuration="1.005717061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:30:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:30:39.004553767 +0000 UTC m=+157.059262394" watchObservedRunningTime="2026-07-22 01:30:39.005717061 +0000 UTC m=+157.060425687" Jul 22 01:30:41.699463 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:41.699429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:48.412886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:48.412845 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:48.413333 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:48.412908 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:48.417827 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:48.417806 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:49.026970 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:49.026945 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:30:49.078154 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:49.078124 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:30:49.205178 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:49.205149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:49.307026 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:49.306945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:30:49.407708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:30:49.407681 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:14.102703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.102636 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74c6f76f7d-hp4hn" podUID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" containerName="console" containerID="cri-o://0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15" gracePeriod=15 Jul 22 01:31:14.343735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.343712 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:31:14.387577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387504 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bct8z\" (UniqueName: \"kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387532 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387592 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387608 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387649 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387669 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.387793 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.387687 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle\") pod \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\" (UID: \"172ef9df-df61-4ab6-b6e9-f5b07d3b6516\") " Jul 22 01:31:14.388690 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.388629 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config" (OuterVolumeSpecName: "console-config") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:31:14.388690 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.388646 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:31:14.388690 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.388643 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:31:14.388690 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.388679 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca" (OuterVolumeSpecName: "service-ca") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:31:14.389950 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.389926 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z" (OuterVolumeSpecName: "kube-api-access-bct8z") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "kube-api-access-bct8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:31:14.390154 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.390127 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:31:14.390476 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.390455 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "172ef9df-df61-4ab6-b6e9-f5b07d3b6516" (UID: "172ef9df-df61-4ab6-b6e9-f5b07d3b6516"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:31:14.489128 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489090 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-oauth-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489145 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-oauth-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489161 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489173 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-service-ca\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489183 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-trusted-ca-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489194 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bct8z\" (UniqueName: \"kubernetes.io/projected/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-kube-api-access-bct8z\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:14.489302 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:14.489208 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/172ef9df-df61-4ab6-b6e9-f5b07d3b6516-console-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:31:15.115354 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.115316 2561 generic.go:356] "Generic (PLEG): container finished" podID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" containerID="0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15" exitCode=0 Jul 22 01:31:15.115758 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.115362 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c6f76f7d-hp4hn" Jul 22 01:31:15.115758 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.115400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c6f76f7d-hp4hn" event={"ID":"172ef9df-df61-4ab6-b6e9-f5b07d3b6516","Type":"ContainerDied","Data":"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15"} Jul 22 01:31:15.115758 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.115456 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c6f76f7d-hp4hn" event={"ID":"172ef9df-df61-4ab6-b6e9-f5b07d3b6516","Type":"ContainerDied","Data":"31d5cd5243f2af3653ef9b524e5079727b0f4ec70efefc807bf73b196815fac6"} Jul 22 01:31:15.115758 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.115502 2561 scope.go:117] "RemoveContainer" containerID="0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15" Jul 22 01:31:15.129965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.129943 2561 scope.go:117] "RemoveContainer" containerID="0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15" Jul 22 01:31:15.130267 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:31:15.130248 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15\": container with ID starting with 0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15 not found: ID does not exist" containerID="0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15" Jul 22 01:31:15.130333 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.130276 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15"} err="failed to get container status \"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15\": rpc error: code = NotFound desc = could not find container \"0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15\": container with ID starting with 0a2dce732100032dd0ea043b6a81ac4731266a4967e32e436eeeb2fe68da6c15 not found: ID does not exist" Jul 22 01:31:15.142715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.142684 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:31:15.148621 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.148596 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c6f76f7d-hp4hn"] Jul 22 01:31:15.421394 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:15.421311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:16.095643 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:16.095608 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" path="/var/lib/kubelet/pods/172ef9df-df61-4ab6-b6e9-f5b07d3b6516/volumes" Jul 22 01:31:43.107965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:43.107923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:43.163753 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:43.163722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:55.002066 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:55.002031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:55.060707 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:55.060671 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:57.678585 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:57.678544 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:57.777989 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:57.777955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:31:58.079580 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:31:58.079501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:00.298122 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.298079 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:32:00.298493 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.298368 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" containerName="console" Jul 22 01:32:00.298493 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.298378 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" containerName="console" Jul 22 01:32:00.298493 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.298439 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="172ef9df-df61-4ab6-b6e9-f5b07d3b6516" containerName="console" Jul 22 01:32:00.301266 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.301248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.315045 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.315015 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:32:00.376343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.376310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:00.428803 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.428750 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:00.463121 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdqfj\" (UniqueName: \"kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.463413 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.463291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.486350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.486325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:00.564311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564242 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564500 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdqfj\" (UniqueName: \"kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564500 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564500 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.564689 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.564528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.565084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.565063 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.565200 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.565091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.565200 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.565169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.565371 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.565354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.566846 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.566817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.566923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.566897 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.574079 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.574051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdqfj\" (UniqueName: \"kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj\") pod \"console-7ccbfdf4c5-7zkgr\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.586705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.586683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:00.609749 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.609730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:00.737684 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:00.737654 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:32:00.740776 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:32:00.740737 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1de16f_4b44_45c2_9c39_ec9eaad97e03.slice/crio-d26997143aa20a12ed74eec875123b1a6072e8412009093a7f158da672baf4f8 WatchSource:0}: Error finding container d26997143aa20a12ed74eec875123b1a6072e8412009093a7f158da672baf4f8: Status 404 returned error can't find the container with id d26997143aa20a12ed74eec875123b1a6072e8412009093a7f158da672baf4f8 Jul 22 01:32:01.283448 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:01.283412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbfdf4c5-7zkgr" event={"ID":"2d1de16f-4b44-45c2-9c39-ec9eaad97e03","Type":"ContainerStarted","Data":"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4"} Jul 22 01:32:01.283614 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:01.283459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbfdf4c5-7zkgr" event={"ID":"2d1de16f-4b44-45c2-9c39-ec9eaad97e03","Type":"ContainerStarted","Data":"d26997143aa20a12ed74eec875123b1a6072e8412009093a7f158da672baf4f8"} Jul 22 01:32:01.304639 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:01.304581 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ccbfdf4c5-7zkgr" podStartSLOduration=1.304566536 podStartE2EDuration="1.304566536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:32:01.302904705 +0000 UTC m=+239.357613358" watchObservedRunningTime="2026-07-22 01:32:01.304566536 +0000 UTC m=+239.359275162" Jul 22 01:32:01.310360 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:01.310329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:01.410860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:01.410832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:10.610577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:10.610547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:10.611038 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:10.610607 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:10.615356 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:10.615333 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:11.323369 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:11.323336 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:32:11.395416 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:11.395378 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:32:11.550122 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:11.550089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:11.653732 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:11.653694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:11.710713 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:11.710683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:36.416560 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.416457 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f8dd5b5b-k54sg" podUID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" containerName="console" containerID="cri-o://e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66" gracePeriod=15 Jul 22 01:32:36.655631 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.655605 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:32:36.744650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744575 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwsvt\" (UniqueName: \"kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744607 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744642 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744944 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744814 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744944 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744867 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744944 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744904 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.744944 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.744939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config\") pod \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\" (UID: \"5d8f1b2d-8017-4960-ab7d-dc3c47eee817\") " Jul 22 01:32:36.745147 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.745074 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:32:36.745282 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.745243 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:32:36.745350 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.745316 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-service-ca\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.745395 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.745365 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:32:36.745429 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.745405 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config" (OuterVolumeSpecName: "console-config") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:32:36.746752 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.746733 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:32:36.746872 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.746855 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt" (OuterVolumeSpecName: "kube-api-access-nwsvt") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "kube-api-access-nwsvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:32:36.746939 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.746926 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d8f1b2d-8017-4960-ab7d-dc3c47eee817" (UID: "5d8f1b2d-8017-4960-ab7d-dc3c47eee817"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:32:36.845823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845786 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwsvt\" (UniqueName: \"kubernetes.io/projected/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-kube-api-access-nwsvt\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.845823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845816 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.845823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845825 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-trusted-ca-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.845823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845833 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-oauth-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.846078 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845842 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:36.846078 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:36.845850 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d8f1b2d-8017-4960-ab7d-dc3c47eee817-console-oauth-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:32:37.416704 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.416667 2561 generic.go:356] "Generic (PLEG): container finished" podID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" containerID="e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66" exitCode=0 Jul 22 01:32:37.417203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.416721 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f8dd5b5b-k54sg" Jul 22 01:32:37.417203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.416725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f8dd5b5b-k54sg" event={"ID":"5d8f1b2d-8017-4960-ab7d-dc3c47eee817","Type":"ContainerDied","Data":"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66"} Jul 22 01:32:37.417203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.416844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f8dd5b5b-k54sg" event={"ID":"5d8f1b2d-8017-4960-ab7d-dc3c47eee817","Type":"ContainerDied","Data":"141e66d665110478aee73a8251d0684994747a2f3da89c87c731bef99627491d"} Jul 22 01:32:37.417203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.416874 2561 scope.go:117] "RemoveContainer" containerID="e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66" Jul 22 01:32:37.425027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.425011 2561 scope.go:117] "RemoveContainer" containerID="e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66" Jul 22 01:32:37.425279 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:32:37.425259 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66\": container with ID starting with e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66 not found: ID does not exist" containerID="e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66" Jul 22 01:32:37.425343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.425292 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66"} err="failed to get container status \"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66\": rpc error: code = NotFound desc = could not find container \"e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66\": container with ID starting with e43c4048b853740f817b1d6c81123573868f154125faf4b34f7f32f605d95c66 not found: ID does not exist" Jul 22 01:32:37.440437 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.440411 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:32:37.444677 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:37.444655 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f8dd5b5b-k54sg"] Jul 22 01:32:38.095636 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:38.095603 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" path="/var/lib/kubelet/pods/5d8f1b2d-8017-4960-ab7d-dc3c47eee817/volumes" Jul 22 01:32:51.483064 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:51.483017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:52.084209 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.084177 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk"] Jul 22 01:32:52.084543 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.084528 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" containerName="console" Jul 22 01:32:52.084620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.084545 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" containerName="console" Jul 22 01:32:52.084620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.084597 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8f1b2d-8017-4960-ab7d-dc3c47eee817" containerName="console" Jul 22 01:32:52.088999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.088980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.092103 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.092079 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h94jg\"" Jul 22 01:32:52.092241 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.092222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:32:52.093017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.092997 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:32:52.099439 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.099416 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk"] Jul 22 01:32:52.266724 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.266692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n5hr\" (UniqueName: \"kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.266910 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.266779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.266910 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.266817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.368223 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.368137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n5hr\" (UniqueName: \"kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.368223 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.368192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.368427 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.368226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.368634 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.368613 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.368700 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.368630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.377967 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.377946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n5hr\" (UniqueName: \"kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.398903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.398882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:32:52.526033 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.526008 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk"] Jul 22 01:32:52.528241 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:32:52.528210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207c6e61_9281_4e69_8715_5062f2c67ae7.slice/crio-9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649 WatchSource:0}: Error finding container 9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649: Status 404 returned error can't find the container with id 9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649 Jul 22 01:32:52.785323 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:52.785227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:53.477926 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:53.477888 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerStarted","Data":"9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649"} Jul 22 01:32:55.672137 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:55.672103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:58.499273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:58.499233 2561 generic.go:356] "Generic (PLEG): container finished" podID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerID="5f9c1a702d455027ff4363c9fc23939249733ca94f83d8f96dbb29a7cefdc419" exitCode=0 Jul 22 01:32:58.499694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:58.499324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerDied","Data":"5f9c1a702d455027ff4363c9fc23939249733ca94f83d8f96dbb29a7cefdc419"} Jul 22 01:32:59.764067 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:59.763992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:32:59.826512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:32:59.826476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:01.512813 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:01.512778 2561 generic.go:356] "Generic (PLEG): container finished" podID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerID="dc25b16dd09842b3d1daf9134bc53d2ce4ca76440b28269dd108c91e43a7edf0" exitCode=0 Jul 22 01:33:01.513180 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:01.512832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerDied","Data":"dc25b16dd09842b3d1daf9134bc53d2ce4ca76440b28269dd108c91e43a7edf0"} Jul 22 01:33:03.046799 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:03.046754 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:33:03.052552 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:03.052530 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 01:33:03.053356 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:03.053337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:33:09.555694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:09.555667 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerStarted","Data":"9f2a409dbbf38b652ce8459aade9027f56a5a4a3f06cd15d05210849ff356e53"} Jul 22 01:33:09.585886 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:09.585838 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" podStartSLOduration=2.245493068 podStartE2EDuration="17.585822064s" totalImagesPullingTime="15.340328996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:32:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:33:09.58563295 +0000 UTC m=+307.640341578" watchObservedRunningTime="2026-07-22 01:33:09.585822064 +0000 UTC m=+307.640530690" Jul 22 01:33:10.561049 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:10.561012 2561 generic.go:356] "Generic (PLEG): container finished" podID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerID="9f2a409dbbf38b652ce8459aade9027f56a5a4a3f06cd15d05210849ff356e53" exitCode=0 Jul 22 01:33:10.561413 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:10.561093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerDied","Data":"9f2a409dbbf38b652ce8459aade9027f56a5a4a3f06cd15d05210849ff356e53"} Jul 22 01:33:11.684944 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.684918 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:33:11.731823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.731785 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle\") pod \"207c6e61-9281-4e69-8715-5062f2c67ae7\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " Jul 22 01:33:11.731823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.731822 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util\") pod \"207c6e61-9281-4e69-8715-5062f2c67ae7\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " Jul 22 01:33:11.732036 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.731869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n5hr\" (UniqueName: \"kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr\") pod \"207c6e61-9281-4e69-8715-5062f2c67ae7\" (UID: \"207c6e61-9281-4e69-8715-5062f2c67ae7\") " Jul 22 01:33:11.732638 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.732605 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle" (OuterVolumeSpecName: "bundle") pod "207c6e61-9281-4e69-8715-5062f2c67ae7" (UID: "207c6e61-9281-4e69-8715-5062f2c67ae7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:11.734112 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.734083 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr" (OuterVolumeSpecName: "kube-api-access-9n5hr") pod "207c6e61-9281-4e69-8715-5062f2c67ae7" (UID: "207c6e61-9281-4e69-8715-5062f2c67ae7"). InnerVolumeSpecName "kube-api-access-9n5hr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:33:11.736155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.736131 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util" (OuterVolumeSpecName: "util") pod "207c6e61-9281-4e69-8715-5062f2c67ae7" (UID: "207c6e61-9281-4e69-8715-5062f2c67ae7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:11.832528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.832503 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:11.832528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.832528 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/207c6e61-9281-4e69-8715-5062f2c67ae7-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:11.832701 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:11.832539 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n5hr\" (UniqueName: \"kubernetes.io/projected/207c6e61-9281-4e69-8715-5062f2c67ae7-kube-api-access-9n5hr\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:12.569560 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:12.569486 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" Jul 22 01:33:12.569560 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:12.569498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409strk" event={"ID":"207c6e61-9281-4e69-8715-5062f2c67ae7","Type":"ContainerDied","Data":"9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649"} Jul 22 01:33:12.569560 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:12.569540 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bc0364cc099c1e790f8372c48ef8bbf8018b2ae41a5f0a6786ceea9c2120649" Jul 22 01:33:18.084150 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:18.084116 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:19.142069 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:19.142037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:20.063371 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063338 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9"] Jul 22 01:33:20.063624 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063613 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="extract" Jul 22 01:33:20.063666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063625 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="extract" Jul 22 01:33:20.063666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063642 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="util" Jul 22 01:33:20.063666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063648 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="util" Jul 22 01:33:20.063666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063654 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="pull" Jul 22 01:33:20.063666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063659 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="pull" Jul 22 01:33:20.063847 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.063711 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="207c6e61-9281-4e69-8715-5062f2c67ae7" containerName="extract" Jul 22 01:33:20.068054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.068035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.071099 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.071077 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:33:20.071214 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.071110 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kzk6m\"" Jul 22 01:33:20.071214 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.071187 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 01:33:20.090331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.090307 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9"] Jul 22 01:33:20.194473 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.194439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qncb7\" (UniqueName: \"kubernetes.io/projected/dbac71fb-0c19-4193-9f52-eedd6010527a-kube-api-access-qncb7\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.194885 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.194498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbac71fb-0c19-4193-9f52-eedd6010527a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.295619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.295570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qncb7\" (UniqueName: \"kubernetes.io/projected/dbac71fb-0c19-4193-9f52-eedd6010527a-kube-api-access-qncb7\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.295619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.295634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbac71fb-0c19-4193-9f52-eedd6010527a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.296091 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.296069 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbac71fb-0c19-4193-9f52-eedd6010527a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.305240 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.305213 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qncb7\" (UniqueName: \"kubernetes.io/projected/dbac71fb-0c19-4193-9f52-eedd6010527a-kube-api-access-qncb7\") pod \"cert-manager-operator-controller-manager-55c444bf86-q42b9\" (UID: \"dbac71fb-0c19-4193-9f52-eedd6010527a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.376715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.376688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" Jul 22 01:33:20.507539 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.507508 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9"] Jul 22 01:33:20.510797 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:20.510753 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbac71fb_0c19_4193_9f52_eedd6010527a.slice/crio-43cd93f591a2ba8cf45def7ecf4cfa817fbe84e5020dc9464eefc6a19015d65d WatchSource:0}: Error finding container 43cd93f591a2ba8cf45def7ecf4cfa817fbe84e5020dc9464eefc6a19015d65d: Status 404 returned error can't find the container with id 43cd93f591a2ba8cf45def7ecf4cfa817fbe84e5020dc9464eefc6a19015d65d Jul 22 01:33:20.513462 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.513442 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:33:20.600333 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:20.600289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" event={"ID":"dbac71fb-0c19-4193-9f52-eedd6010527a","Type":"ContainerStarted","Data":"43cd93f591a2ba8cf45def7ecf4cfa817fbe84e5020dc9464eefc6a19015d65d"} Jul 22 01:33:21.711258 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:21.711215 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:21.813776 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:21.813717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:24.621898 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:24.621862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" event={"ID":"dbac71fb-0c19-4193-9f52-eedd6010527a","Type":"ContainerStarted","Data":"67401f7cb6d18d95643c685230957c956661b38cb5ca236976b6e34fc6e65042"} Jul 22 01:33:24.645136 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:24.645085 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q42b9" podStartSLOduration=0.915788099 podStartE2EDuration="4.645066461s" totalImagesPullingTime="3.729278362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:33:24.643129884 +0000 UTC m=+322.697838512" watchObservedRunningTime="2026-07-22 01:33:24.645066461 +0000 UTC m=+322.699775087" Jul 22 01:33:25.014489 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.014407 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:25.115652 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.115619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:25.250619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.250586 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6"] Jul 22 01:33:25.253482 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.253465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.256234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.256208 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h94jg\"" Jul 22 01:33:25.256390 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.256289 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:33:25.256495 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.256481 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:33:25.282211 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.282147 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6"] Jul 22 01:33:25.287856 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.287822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:25.338357 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.338324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.338557 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.338374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxzlg\" (UniqueName: \"kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.338557 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.338489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.386524 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.386493 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:25.439831 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.439798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.439987 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.439858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.439987 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.439976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxzlg\" (UniqueName: \"kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.440221 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.440200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.440287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.440229 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.457222 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.457193 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxzlg\" (UniqueName: \"kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.562921 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.562855 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:25.695817 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:25.695657 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6"] Jul 22 01:33:25.698312 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:25.698277 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cdaddc_cc4e_4ec6_82e4_7ffb860b78e7.slice/crio-d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904 WatchSource:0}: Error finding container d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904: Status 404 returned error can't find the container with id d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904 Jul 22 01:33:26.633249 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:26.633217 2561 generic.go:356] "Generic (PLEG): container finished" podID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerID="ba10fddd381401df2977457597dabbc989cc00a636fe086cdf93689398302bf6" exitCode=0 Jul 22 01:33:26.633405 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:26.633275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" event={"ID":"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7","Type":"ContainerDied","Data":"ba10fddd381401df2977457597dabbc989cc00a636fe086cdf93689398302bf6"} Jul 22 01:33:26.633405 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:26.633324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" event={"ID":"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7","Type":"ContainerStarted","Data":"d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904"} Jul 22 01:33:27.664002 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:27.663936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:27.856914 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:27.856874 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:28.093667 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.093635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:28.194105 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.194069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:28.271576 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.271547 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gglcr"] Jul 22 01:33:28.276496 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.276474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.279081 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.279062 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 01:33:28.279201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.279158 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x6nx6\"" Jul 22 01:33:28.279331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.279309 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 01:33:28.285033 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.284991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gglcr"] Jul 22 01:33:28.361791 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.361690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.361933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.361805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xhcc\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-kube-api-access-5xhcc\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.462228 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.462187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.462391 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.462307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xhcc\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-kube-api-access-5xhcc\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.471596 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.471564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.471727 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.471706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xhcc\" (UniqueName: \"kubernetes.io/projected/f1e62e7a-691f-4a7a-b8a4-8e063629e83a-kube-api-access-5xhcc\") pod \"cert-manager-cainjector-559cdd8c87-gglcr\" (UID: \"f1e62e7a-691f-4a7a-b8a4-8e063629e83a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.595953 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.595920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" Jul 22 01:33:28.971711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:28.971679 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gglcr"] Jul 22 01:33:28.974806 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:28.974781 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1e62e7a_691f_4a7a_b8a4_8e063629e83a.slice/crio-d75c031f3238bdec704fb67260e1bc75fd480ceb8876c96d5bc4de5d690d2f2c WatchSource:0}: Error finding container d75c031f3238bdec704fb67260e1bc75fd480ceb8876c96d5bc4de5d690d2f2c: Status 404 returned error can't find the container with id d75c031f3238bdec704fb67260e1bc75fd480ceb8876c96d5bc4de5d690d2f2c Jul 22 01:33:29.640647 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.640611 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bzbzp"] Jul 22 01:33:29.643081 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.643062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.645632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.645614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mwm8b\"" Jul 22 01:33:29.649554 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.649530 2561 generic.go:356] "Generic (PLEG): container finished" podID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerID="33b6c9ffeeef0faeca5b74a1d97d186829d2b07ea4d8eb478f9b208d1f603a33" exitCode=0 Jul 22 01:33:29.649674 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.649588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" event={"ID":"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7","Type":"ContainerDied","Data":"33b6c9ffeeef0faeca5b74a1d97d186829d2b07ea4d8eb478f9b208d1f603a33"} Jul 22 01:33:29.651803 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.651747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" event={"ID":"f1e62e7a-691f-4a7a-b8a4-8e063629e83a","Type":"ContainerStarted","Data":"d75c031f3238bdec704fb67260e1bc75fd480ceb8876c96d5bc4de5d690d2f2c"} Jul 22 01:33:29.653852 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.653831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bzbzp"] Jul 22 01:33:29.774726 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.774691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxvm\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-kube-api-access-5bxvm\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.774890 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.774737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.875624 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.875589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxvm\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-kube-api-access-5bxvm\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.875799 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.875639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.885648 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.885614 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.885747 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.885674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxvm\" (UniqueName: \"kubernetes.io/projected/5bb14e7f-036a-4c71-b00f-de254b9f5c3a-kube-api-access-5bxvm\") pod \"cert-manager-webhook-6486ffd997-bzbzp\" (UID: \"5bb14e7f-036a-4c71-b00f-de254b9f5c3a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:29.953663 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:29.953623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:30.098713 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:30.098521 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bzbzp"] Jul 22 01:33:30.101233 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:30.101203 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bb14e7f_036a_4c71_b00f_de254b9f5c3a.slice/crio-9583e4ecf390b8a69b2173aa22928946fe377837bdfdf9652880cd192adfffe9 WatchSource:0}: Error finding container 9583e4ecf390b8a69b2173aa22928946fe377837bdfdf9652880cd192adfffe9: Status 404 returned error can't find the container with id 9583e4ecf390b8a69b2173aa22928946fe377837bdfdf9652880cd192adfffe9 Jul 22 01:33:30.659434 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:30.659398 2561 generic.go:356] "Generic (PLEG): container finished" podID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerID="fb7a8472ef5de27f7747753861309ae47a8556869fb78e0d65fbe96dfea43462" exitCode=0 Jul 22 01:33:30.659627 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:30.659485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" event={"ID":"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7","Type":"ContainerDied","Data":"fb7a8472ef5de27f7747753861309ae47a8556869fb78e0d65fbe96dfea43462"} Jul 22 01:33:30.660933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:30.660899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" event={"ID":"5bb14e7f-036a-4c71-b00f-de254b9f5c3a","Type":"ContainerStarted","Data":"9583e4ecf390b8a69b2173aa22928946fe377837bdfdf9652880cd192adfffe9"} Jul 22 01:33:32.096124 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.096100 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:32.196999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.196973 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle\") pod \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " Jul 22 01:33:32.197106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.197064 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxzlg\" (UniqueName: \"kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg\") pod \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " Jul 22 01:33:32.197106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.197100 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util\") pod \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\" (UID: \"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7\") " Jul 22 01:33:32.197449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.197424 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle" (OuterVolumeSpecName: "bundle") pod "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" (UID: "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:32.199547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.199520 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg" (OuterVolumeSpecName: "kube-api-access-qxzlg") pod "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" (UID: "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7"). InnerVolumeSpecName "kube-api-access-qxzlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:33:32.201805 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.201748 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util" (OuterVolumeSpecName: "util") pod "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" (UID: "21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:32.298550 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.298520 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:32.298550 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.298547 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:32.298550 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.298556 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxzlg\" (UniqueName: \"kubernetes.io/projected/21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7-kube-api-access-qxzlg\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:32.672273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.672231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" event={"ID":"5bb14e7f-036a-4c71-b00f-de254b9f5c3a","Type":"ContainerStarted","Data":"6b880b1a110d9d30e5df0b5ecf4c7fc850c2aea641b21b4f3e6dec547350bdb9"} Jul 22 01:33:32.672605 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.672283 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:32.674143 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.674112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" event={"ID":"21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7","Type":"ContainerDied","Data":"d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904"} Jul 22 01:33:32.674269 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.674157 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8f4c0f5cd825f4f8c1f37da165437047123ae73f9cf239239aeb4ee1eede904" Jul 22 01:33:32.674269 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.674121 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsmhm6" Jul 22 01:33:32.675630 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.675590 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" event={"ID":"f1e62e7a-691f-4a7a-b8a4-8e063629e83a","Type":"ContainerStarted","Data":"c238c0b11a110c406d5bf70a4d0b57d6f7594d62f7fbda489430488355a30ab6"} Jul 22 01:33:32.692992 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.692947 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" podStartSLOduration=1.655963238 podStartE2EDuration="3.692932229s" totalImagesPullingTime="2.036968991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:33:32.691161043 +0000 UTC m=+330.745869670" watchObservedRunningTime="2026-07-22 01:33:32.692932229 +0000 UTC m=+330.747640833" Jul 22 01:33:32.714003 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.713954 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gglcr" podStartSLOduration=1.560443109 podStartE2EDuration="4.713938731s" totalImagesPullingTime="3.153495622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:33:32.711911695 +0000 UTC m=+330.766620321" watchObservedRunningTime="2026-07-22 01:33:32.713938731 +0000 UTC m=+330.768647358" Jul 22 01:33:32.958610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:32.958527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:33.052733 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:33.052701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:35.462066 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:35.462034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:35.986623 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:35.986587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:36.086371 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:36.086296 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:37.806591 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806557 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5hkw"] Jul 22 01:33:37.806956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806905 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="extract" Jul 22 01:33:37.806956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806919 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="extract" Jul 22 01:33:37.806956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806940 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="util" Jul 22 01:33:37.806956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806946 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="util" Jul 22 01:33:37.806956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806954 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="pull" Jul 22 01:33:37.807116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.806960 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="pull" Jul 22 01:33:37.807116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.807007 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cdaddc-cc4e-4ec6-82e4-7ffb860b78e7" containerName="extract" Jul 22 01:33:37.809243 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.809228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:37.812202 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.812184 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dxlbb\"" Jul 22 01:33:37.821098 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.821072 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5hkw"] Jul 22 01:33:37.950112 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.950076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnrg6\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-kube-api-access-pnrg6\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:37.950277 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:37.950163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.050932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.050897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.050932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.050941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnrg6\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-kube-api-access-pnrg6\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.059686 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.059617 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnrg6\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-kube-api-access-pnrg6\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.059913 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.059895 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/947aac3e-889c-45f3-a6c1-a4b37575eb40-bound-sa-token\") pod \"cert-manager-55b4d954d5-d5hkw\" (UID: \"947aac3e-889c-45f3-a6c1-a4b37575eb40\") " pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.118285 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.118255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d5hkw" Jul 22 01:33:38.247798 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.247749 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d5hkw"] Jul 22 01:33:38.251203 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:38.251169 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod947aac3e_889c_45f3_a6c1_a4b37575eb40.slice/crio-981df280c6090ec296f919369245ef2c1c143c919852fc4af029329c69843634 WatchSource:0}: Error finding container 981df280c6090ec296f919369245ef2c1c143c919852fc4af029329c69843634: Status 404 returned error can't find the container with id 981df280c6090ec296f919369245ef2c1c143c919852fc4af029329c69843634 Jul 22 01:33:38.682278 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.682250 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bzbzp" Jul 22 01:33:38.701706 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.701668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d5hkw" event={"ID":"947aac3e-889c-45f3-a6c1-a4b37575eb40","Type":"ContainerStarted","Data":"ae034ab452bc74349ad61b045a59b1ff97486d7716c120b0699d82272999ab9e"} Jul 22 01:33:38.701870 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.701712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d5hkw" event={"ID":"947aac3e-889c-45f3-a6c1-a4b37575eb40","Type":"ContainerStarted","Data":"981df280c6090ec296f919369245ef2c1c143c919852fc4af029329c69843634"} Jul 22 01:33:38.722203 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:38.722154 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d5hkw" podStartSLOduration=1.7221392770000001 podStartE2EDuration="1.722139277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:33:38.720757359 +0000 UTC m=+336.775465987" watchObservedRunningTime="2026-07-22 01:33:38.722139277 +0000 UTC m=+336.776847904" Jul 22 01:33:42.121167 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:42.121134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:42.220448 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:42.220421 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:43.793035 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.792999 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs"] Jul 22 01:33:43.795835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.795811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.798401 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.798377 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:33:43.798528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.798389 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h94jg\"" Jul 22 01:33:43.799331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.799317 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:33:43.808961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.808938 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs"] Jul 22 01:33:43.895943 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.895912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:43.898138 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.898117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.898233 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.898149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgv62\" (UniqueName: \"kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.898276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.898226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.998664 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.998634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.998811 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.998703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.998811 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.998725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgv62\" (UniqueName: \"kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.999050 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.999030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:43.999115 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:43.999097 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:44.008352 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.008315 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgv62\" (UniqueName: \"kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:44.105406 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.105382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:44.233066 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.233041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs"] Jul 22 01:33:44.235091 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:44.235062 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398a78fa_1a16_4bec_91b7_3d0ae614a0b1.slice/crio-1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4 WatchSource:0}: Error finding container 1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4: Status 404 returned error can't find the container with id 1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4 Jul 22 01:33:44.730008 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.729976 2561 generic.go:356] "Generic (PLEG): container finished" podID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerID="7320cb2891fd7d233d3f0c27b578cc354b5d1408f81393b7bd33de1f959ddebe" exitCode=0 Jul 22 01:33:44.730236 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.730060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" event={"ID":"398a78fa-1a16-4bec-91b7-3d0ae614a0b1","Type":"ContainerDied","Data":"7320cb2891fd7d233d3f0c27b578cc354b5d1408f81393b7bd33de1f959ddebe"} Jul 22 01:33:44.730236 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:44.730093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" event={"ID":"398a78fa-1a16-4bec-91b7-3d0ae614a0b1","Type":"ContainerStarted","Data":"1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4"} Jul 22 01:33:45.735920 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:45.735884 2561 generic.go:356] "Generic (PLEG): container finished" podID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerID="60e94db2037cc2e87aeb960dce7ebf25aabef1d36920243ffaf4d4db57872383" exitCode=0 Jul 22 01:33:45.736328 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:45.735963 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" event={"ID":"398a78fa-1a16-4bec-91b7-3d0ae614a0b1","Type":"ContainerDied","Data":"60e94db2037cc2e87aeb960dce7ebf25aabef1d36920243ffaf4d4db57872383"} Jul 22 01:33:46.741961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:46.741924 2561 generic.go:356] "Generic (PLEG): container finished" podID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerID="b0bf75ec0e6390288a7b93301311bf4cfc70427ec2ea01704781f453325dbcbf" exitCode=0 Jul 22 01:33:46.742328 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:46.741979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" event={"ID":"398a78fa-1a16-4bec-91b7-3d0ae614a0b1","Type":"ContainerDied","Data":"b0bf75ec0e6390288a7b93301311bf4cfc70427ec2ea01704781f453325dbcbf"} Jul 22 01:33:47.878707 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.878683 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:47.930136 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.930104 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle\") pod \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " Jul 22 01:33:47.930136 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.930145 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util\") pod \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " Jul 22 01:33:47.930374 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.930225 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgv62\" (UniqueName: \"kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62\") pod \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\" (UID: \"398a78fa-1a16-4bec-91b7-3d0ae614a0b1\") " Jul 22 01:33:47.930746 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.930724 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle" (OuterVolumeSpecName: "bundle") pod "398a78fa-1a16-4bec-91b7-3d0ae614a0b1" (UID: "398a78fa-1a16-4bec-91b7-3d0ae614a0b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:47.932261 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.932238 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62" (OuterVolumeSpecName: "kube-api-access-qgv62") pod "398a78fa-1a16-4bec-91b7-3d0ae614a0b1" (UID: "398a78fa-1a16-4bec-91b7-3d0ae614a0b1"). InnerVolumeSpecName "kube-api-access-qgv62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:33:47.935846 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:47.935821 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util" (OuterVolumeSpecName: "util") pod "398a78fa-1a16-4bec-91b7-3d0ae614a0b1" (UID: "398a78fa-1a16-4bec-91b7-3d0ae614a0b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:33:48.031632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.031559 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:48.031632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.031588 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:48.031632 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.031599 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgv62\" (UniqueName: \"kubernetes.io/projected/398a78fa-1a16-4bec-91b7-3d0ae614a0b1-kube-api-access-qgv62\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:33:48.757744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.757711 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" Jul 22 01:33:48.757744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.757731 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpd4hs" event={"ID":"398a78fa-1a16-4bec-91b7-3d0ae614a0b1","Type":"ContainerDied","Data":"1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4"} Jul 22 01:33:48.757968 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:48.757792 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f7ec598a5cea18b76b52bc84bbd521a34efb42a1fd0b42402505f5c76d1e4e4" Jul 22 01:33:57.139625 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:57.139535 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:57.241419 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:57.241391 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:57.757013 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:57.756977 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:57.995353 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:57.995323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.084374 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.084347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.140321 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140293 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d"] Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140598 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="extract" Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140609 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="extract" Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140630 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="util" Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140636 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="util" Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140643 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="pull" Jul 22 01:33:58.140693 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140650 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="pull" Jul 22 01:33:58.140935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.140697 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="398a78fa-1a16-4bec-91b7-3d0ae614a0b1" containerName="extract" Jul 22 01:33:58.143042 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.143025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.146782 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.146738 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 01:33:58.146982 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.146953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 01:33:58.147142 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.147057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 01:33:58.147673 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.147657 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 01:33:58.147738 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.147652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x7rff\"" Jul 22 01:33:58.162419 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.162397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d"] Jul 22 01:33:58.213997 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.213963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fd2k\" (UniqueName: \"kubernetes.io/projected/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-kube-api-access-6fd2k\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.214173 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.214026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.214173 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.214051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.214173 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.214092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.214173 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.214115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.291084 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.291049 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.315377 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.315511 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.315511 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.315511 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.315659 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fd2k\" (UniqueName: \"kubernetes.io/projected/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-kube-api-access-6fd2k\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.315953 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.315932 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.317751 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.317730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.317961 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.317944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.318030 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.317960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.328440 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.328419 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fd2k\" (UniqueName: \"kubernetes.io/projected/98e3b98e-039f-4c7d-a2fe-5b406f6441a8-kube-api-access-6fd2k\") pod \"opendatahub-operator-controller-manager-9869b8c7c-xft5d\" (UID: \"98e3b98e-039f-4c7d-a2fe-5b406f6441a8\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.382375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.382307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.454187 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.454145 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:33:58.482894 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.482864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.582992 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.582933 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.589958 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.589863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d"] Jul 22 01:33:58.592014 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:33:58.591988 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e3b98e_039f_4c7d_a2fe_5b406f6441a8.slice/crio-71693e8d7f3083e33117b71e903a8b70b380809d4199371220892c3423b52a5d WatchSource:0}: Error finding container 71693e8d7f3083e33117b71e903a8b70b380809d4199371220892c3423b52a5d: Status 404 returned error can't find the container with id 71693e8d7f3083e33117b71e903a8b70b380809d4199371220892c3423b52a5d Jul 22 01:33:58.715475 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.715398 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:33:58.801395 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.801361 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" event={"ID":"98e3b98e-039f-4c7d-a2fe-5b406f6441a8","Type":"ContainerStarted","Data":"71693e8d7f3083e33117b71e903a8b70b380809d4199371220892c3423b52a5d"} Jul 22 01:33:58.879830 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:33:58.879797 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:00.209908 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:00.209869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:00.344046 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:00.344014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:01.818253 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:01.818210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" event={"ID":"98e3b98e-039f-4c7d-a2fe-5b406f6441a8","Type":"ContainerStarted","Data":"df21adc99f9eed7b9613561565b0363bc92e9df09a879266b1eb2f531fa56e40"} Jul 22 01:34:02.824351 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:02.824302 2561 generic.go:356] "Generic (PLEG): container finished" podID="98e3b98e-039f-4c7d-a2fe-5b406f6441a8" containerID="df21adc99f9eed7b9613561565b0363bc92e9df09a879266b1eb2f531fa56e40" exitCode=0 Jul 22 01:34:02.824704 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:02.824387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" event={"ID":"98e3b98e-039f-4c7d-a2fe-5b406f6441a8","Type":"ContainerDied","Data":"df21adc99f9eed7b9613561565b0363bc92e9df09a879266b1eb2f531fa56e40"} Jul 22 01:34:03.831146 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:03.831112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" event={"ID":"98e3b98e-039f-4c7d-a2fe-5b406f6441a8","Type":"ContainerStarted","Data":"13e6598ea74fad083db91b1095573de38147f70aa8c4c2cf8ffd283553f8614f"} Jul 22 01:34:03.831589 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:03.831226 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:34:03.863101 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:03.863043 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" podStartSLOduration=1.110765866 podStartE2EDuration="5.863026528s" totalImagesPullingTime="3.729114261s" totalInitContainerRuntime="1.023146401s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:03.861470881 +0000 UTC m=+361.916179511" watchObservedRunningTime="2026-07-22 01:34:03.863026528 +0000 UTC m=+361.917735154" Jul 22 01:34:14.838354 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:14.838318 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-xft5d" Jul 22 01:34:17.338476 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:17.338430 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:17.441394 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:17.441348 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:18.335890 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.335846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:18.483322 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.483284 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:18.584932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.584891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:18.979624 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.979591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:18.981567 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.981544 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w8wqz"] Jul 22 01:34:18.987655 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.987639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:18.990032 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:18.990005 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 22 01:34:19.006201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.006170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w8wqz"] Jul 22 01:34:19.103779 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.103734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc1262e6-2185-433e-a1d9-277d040925ac-tls-certs\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.103937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.103800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkjt5\" (UniqueName: \"kubernetes.io/projected/bc1262e6-2185-433e-a1d9-277d040925ac-kube-api-access-lkjt5\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.114772 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.114732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:19.205140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.205110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc1262e6-2185-433e-a1d9-277d040925ac-tls-certs\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.205325 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.205152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkjt5\" (UniqueName: \"kubernetes.io/projected/bc1262e6-2185-433e-a1d9-277d040925ac-kube-api-access-lkjt5\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.207633 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.207612 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc1262e6-2185-433e-a1d9-277d040925ac-tls-certs\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.222450 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.222418 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkjt5\" (UniqueName: \"kubernetes.io/projected/bc1262e6-2185-433e-a1d9-277d040925ac-kube-api-access-lkjt5\") pod \"model-serving-api-54d89bd5fc-w8wqz\" (UID: \"bc1262e6-2185-433e-a1d9-277d040925ac\") " pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.298864 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.298785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:19.464600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.464571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w8wqz"] Jul 22 01:34:19.466792 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:34:19.466741 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1262e6_2185_433e_a1d9_277d040925ac.slice/crio-c90eea3af7adf00deddf550b55741f762ac832bb863b2cc4b61c2a04a0bf4eb4 WatchSource:0}: Error finding container c90eea3af7adf00deddf550b55741f762ac832bb863b2cc4b61c2a04a0bf4eb4: Status 404 returned error can't find the container with id c90eea3af7adf00deddf550b55741f762ac832bb863b2cc4b61c2a04a0bf4eb4 Jul 22 01:34:19.908830 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:19.908797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" event={"ID":"bc1262e6-2185-433e-a1d9-277d040925ac","Type":"ContainerStarted","Data":"c90eea3af7adf00deddf550b55741f762ac832bb863b2cc4b61c2a04a0bf4eb4"} Jul 22 01:34:21.920822 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:21.920786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" event={"ID":"bc1262e6-2185-433e-a1d9-277d040925ac","Type":"ContainerStarted","Data":"cbd6a06bdd6f0f178505d34fba3745fe6683002f3b47bfc6f717b430fef6458a"} Jul 22 01:34:21.921237 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:21.920884 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:21.946040 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:21.945991 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" podStartSLOduration=2.400477394 podStartE2EDuration="3.945977379s" totalImagesPullingTime="1.545499985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:21.945413299 +0000 UTC m=+380.000121926" watchObservedRunningTime="2026-07-22 01:34:21.945977379 +0000 UTC m=+380.000686006" Jul 22 01:34:25.042495 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.042460 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz"] Jul 22 01:34:25.045157 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.045140 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.049017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.048987 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 01:34:25.049017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.049012 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:34:25.049210 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.049191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 01:34:25.049274 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.049215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 01:34:25.049336 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.049318 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 01:34:25.049385 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.049338 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6mlcj\"" Jul 22 01:34:25.057588 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.057558 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz"] Jul 22 01:34:25.157436 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.157404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.157594 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.157446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5h85\" (UniqueName: \"kubernetes.io/projected/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-kube-api-access-b5h85\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.157594 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.157501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-manager-config\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.157594 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.157538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-metrics-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.258315 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.258279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5h85\" (UniqueName: \"kubernetes.io/projected/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-kube-api-access-b5h85\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.258509 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.258345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-manager-config\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.258509 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.258378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-metrics-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.258509 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.258452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.259119 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.259089 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-manager-config\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.261132 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.261104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.261275 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.261261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-metrics-cert\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.273972 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.273947 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5h85\" (UniqueName: \"kubernetes.io/projected/4a0050ff-853a-41f2-9ad3-df3d9d70df2b-kube-api-access-b5h85\") pod \"lws-controller-manager-7898dc9f59-74tlz\" (UID: \"4a0050ff-853a-41f2-9ad3-df3d9d70df2b\") " pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.353845 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.353810 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:25.510677 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.510647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz"] Jul 22 01:34:25.514025 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:34:25.513986 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0050ff_853a_41f2_9ad3_df3d9d70df2b.slice/crio-f7c3e23cd00614d867e0a09a94259a75eec0b56404dcd7e89768ce91ce1cb26d WatchSource:0}: Error finding container f7c3e23cd00614d867e0a09a94259a75eec0b56404dcd7e89768ce91ce1cb26d: Status 404 returned error can't find the container with id f7c3e23cd00614d867e0a09a94259a75eec0b56404dcd7e89768ce91ce1cb26d Jul 22 01:34:25.941052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:25.941016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" event={"ID":"4a0050ff-853a-41f2-9ad3-df3d9d70df2b","Type":"ContainerStarted","Data":"f7c3e23cd00614d867e0a09a94259a75eec0b56404dcd7e89768ce91ce1cb26d"} Jul 22 01:34:27.952930 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:27.952889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" event={"ID":"4a0050ff-853a-41f2-9ad3-df3d9d70df2b","Type":"ContainerStarted","Data":"2c565762810d3a1e7f061cc7c0fabd932429b7289612f6f9bca3bfec017d85ab"} Jul 22 01:34:27.953477 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:27.952989 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:27.994136 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:27.994081 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" podStartSLOduration=1.252954184 podStartE2EDuration="2.994062028s" totalImagesPullingTime="1.741107844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:27.99037797 +0000 UTC m=+386.045086596" watchObservedRunningTime="2026-07-22 01:34:27.994062028 +0000 UTC m=+386.048770655" Jul 22 01:34:28.231488 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.231411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.355092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.355062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.439827 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.439791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.564707 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.564624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.656304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.656271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.742227 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.742196 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:28.907922 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:28.907890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:29.606781 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:29.606729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:29.679895 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:29.679863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:29.769057 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:29.769024 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:30.615741 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:30.615710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:30.694955 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:30.694923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:32.164865 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:32.164829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:32.929932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:32.929896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-w8wqz" Jul 22 01:34:35.061913 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:35.061878 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:35.162738 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:35.162704 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:36.051698 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.051666 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7"] Jul 22 01:34:36.060017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.059995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.064998 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.064975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 01:34:36.065407 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.065383 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 01:34:36.065836 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.065625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jxx8b\"" Jul 22 01:34:36.065836 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.065722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 01:34:36.068948 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.068928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7"] Jul 22 01:34:36.153713 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a432763-81d3-449b-bc26-54ecbff3be78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.153923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.153923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.153923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a432763-81d3-449b-bc26-54ecbff3be78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.153923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.154145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.153966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.154145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.154034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4mz\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-kube-api-access-mr4mz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.154145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.154079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.154145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.154115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255260 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255260 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a432763-81d3-449b-bc26-54ecbff3be78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a432763-81d3-449b-bc26-54ecbff3be78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255491 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4mz\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-kube-api-access-mr4mz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255880 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.255880 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.256010 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.255991 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.256055 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.256030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.256268 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.256241 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a432763-81d3-449b-bc26-54ecbff3be78-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.257833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.257804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a432763-81d3-449b-bc26-54ecbff3be78-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.258080 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.258059 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a432763-81d3-449b-bc26-54ecbff3be78-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.264816 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.264797 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4mz\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-kube-api-access-mr4mz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.266823 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.266804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a432763-81d3-449b-bc26-54ecbff3be78-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rp6k7\" (UID: \"4a432763-81d3-449b-bc26-54ecbff3be78\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.370917 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.370883 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:36.514975 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.514950 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7"] Jul 22 01:34:36.517316 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:34:36.517288 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a432763_81d3_449b_bc26_54ecbff3be78.slice/crio-a4b09092d72cbc60d86f108fe30f0ffb50ca9bed7804becdaf60dccd3b2d2d40 WatchSource:0}: Error finding container a4b09092d72cbc60d86f108fe30f0ffb50ca9bed7804becdaf60dccd3b2d2d40: Status 404 returned error can't find the container with id a4b09092d72cbc60d86f108fe30f0ffb50ca9bed7804becdaf60dccd3b2d2d40 Jul 22 01:34:36.572444 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.572405 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:36.665821 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.665727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:36.951325 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.951223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:34:36.996171 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:36.996136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" event={"ID":"4a432763-81d3-449b-bc26-54ecbff3be78","Type":"ContainerStarted","Data":"a4b09092d72cbc60d86f108fe30f0ffb50ca9bed7804becdaf60dccd3b2d2d40"} Jul 22 01:34:38.961225 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:38.961192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7898dc9f59-74tlz" Jul 22 01:34:39.600663 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:39.600632 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:34:39.600752 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:39.600703 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:34:39.600752 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:39.600732 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:34:40.014338 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:40.014250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" event={"ID":"4a432763-81d3-449b-bc26-54ecbff3be78","Type":"ContainerStarted","Data":"bdcbf7dbc9b7101366c61a7a39f17037e8f909d1b736224c21fc3215abc50422"} Jul 22 01:34:40.046125 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:40.046064 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" podStartSLOduration=0.964955243 podStartE2EDuration="4.046048634s" totalImagesPullingTime="3.081093391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:40.044718655 +0000 UTC m=+398.099427285" watchObservedRunningTime="2026-07-22 01:34:40.046048634 +0000 UTC m=+398.100757261" Jul 22 01:34:40.372047 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:40.372008 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:40.376819 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:40.376785 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:41.019370 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:41.019341 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:34:41.020310 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:34:41.020292 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rp6k7" Jul 22 01:35:11.804095 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:11.804059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:11.866547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:11.866508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:13.868514 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:13.868473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:14.057976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:14.057941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:18.831241 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.831203 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:18.926421 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.926389 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:18.982964 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.982929 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:18.993433 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.993398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:18.996446 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.996420 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 01:35:18.997343 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.997322 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wv4sm\"" Jul 22 01:35:18.997478 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:18.997344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 01:35:19.007694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.007669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:19.115433 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.115345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8zp\" (UniqueName: \"kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp\") pod \"kuadrant-operator-catalog-442ck\" (UID: \"8b736fb2-7ef2-45de-8c7d-213d427fbac4\") " pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:19.216670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.216636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8zp\" (UniqueName: \"kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp\") pod \"kuadrant-operator-catalog-442ck\" (UID: \"8b736fb2-7ef2-45de-8c7d-213d427fbac4\") " pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:19.231120 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.231091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8zp\" (UniqueName: \"kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp\") pod \"kuadrant-operator-catalog-442ck\" (UID: \"8b736fb2-7ef2-45de-8c7d-213d427fbac4\") " pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:19.244862 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.244837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:19.305532 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.305508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:19.329789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.329746 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:19.449497 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.449467 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:19.452482 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:19.452447 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b736fb2_7ef2_45de_8c7d_213d427fbac4.slice/crio-f525987c9d0fb7d8de0525b2d1b09239ca1f177be576ed0f2d9acb388233f57f WatchSource:0}: Error finding container f525987c9d0fb7d8de0525b2d1b09239ca1f177be576ed0f2d9acb388233f57f: Status 404 returned error can't find the container with id f525987c9d0fb7d8de0525b2d1b09239ca1f177be576ed0f2d9acb388233f57f Jul 22 01:35:19.534461 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.534430 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xcm67"] Jul 22 01:35:19.539335 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.539317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:19.556646 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.556618 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xcm67"] Jul 22 01:35:19.619489 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.619464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4m5k\" (UniqueName: \"kubernetes.io/projected/bd249680-d71e-4fb7-8154-98b62e1810b8-kube-api-access-z4m5k\") pod \"kuadrant-operator-catalog-xcm67\" (UID: \"bd249680-d71e-4fb7-8154-98b62e1810b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:19.720738 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.720646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4m5k\" (UniqueName: \"kubernetes.io/projected/bd249680-d71e-4fb7-8154-98b62e1810b8-kube-api-access-z4m5k\") pod \"kuadrant-operator-catalog-xcm67\" (UID: \"bd249680-d71e-4fb7-8154-98b62e1810b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:19.732668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.732642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4m5k\" (UniqueName: \"kubernetes.io/projected/bd249680-d71e-4fb7-8154-98b62e1810b8-kube-api-access-z4m5k\") pod \"kuadrant-operator-catalog-xcm67\" (UID: \"bd249680-d71e-4fb7-8154-98b62e1810b8\") " pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:19.773028 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.772999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:19.848181 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.848146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:19.996324 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:19.996249 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:20.003056 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:20.003036 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xcm67"] Jul 22 01:35:20.038240 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:20.038211 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd249680_d71e_4fb7_8154_98b62e1810b8.slice/crio-198cbac08e449f1a70e30a17534326056a18fc176d7c920539271ec9b1f4b42d WatchSource:0}: Error finding container 198cbac08e449f1a70e30a17534326056a18fc176d7c920539271ec9b1f4b42d: Status 404 returned error can't find the container with id 198cbac08e449f1a70e30a17534326056a18fc176d7c920539271ec9b1f4b42d Jul 22 01:35:20.196660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:20.196623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" event={"ID":"bd249680-d71e-4fb7-8154-98b62e1810b8","Type":"ContainerStarted","Data":"198cbac08e449f1a70e30a17534326056a18fc176d7c920539271ec9b1f4b42d"} Jul 22 01:35:20.197805 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:20.197778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-442ck" event={"ID":"8b736fb2-7ef2-45de-8c7d-213d427fbac4","Type":"ContainerStarted","Data":"f525987c9d0fb7d8de0525b2d1b09239ca1f177be576ed0f2d9acb388233f57f"} Jul 22 01:35:22.209238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.209133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-442ck" event={"ID":"8b736fb2-7ef2-45de-8c7d-213d427fbac4","Type":"ContainerStarted","Data":"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3"} Jul 22 01:35:22.209238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.209146 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-442ck" podUID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" containerName="registry-server" containerID="cri-o://5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3" gracePeriod=2 Jul 22 01:35:22.210789 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.210749 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" event={"ID":"bd249680-d71e-4fb7-8154-98b62e1810b8","Type":"ContainerStarted","Data":"cdb4c1e113bd62b5c0f53aae4dfa1e6fa05dc88ac5100f27b0afc1fab50c871b"} Jul 22 01:35:22.230870 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.230827 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-442ck" podStartSLOduration=2.209982586 podStartE2EDuration="4.230811339s" totalImagesPullingTime="2.020828753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:35:22.229512401 +0000 UTC m=+440.284221029" watchObservedRunningTime="2026-07-22 01:35:22.230811339 +0000 UTC m=+440.285519956" Jul 22 01:35:22.250144 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.250100 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" podStartSLOduration=1.418553766 podStartE2EDuration="3.250086927s" totalImagesPullingTime="1.831533161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:35:22.247572007 +0000 UTC m=+440.302280656" watchObservedRunningTime="2026-07-22 01:35:22.250086927 +0000 UTC m=+440.304795553" Jul 22 01:35:22.450169 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.450146 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:22.547507 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.547432 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8zp\" (UniqueName: \"kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp\") pod \"8b736fb2-7ef2-45de-8c7d-213d427fbac4\" (UID: \"8b736fb2-7ef2-45de-8c7d-213d427fbac4\") " Jul 22 01:35:22.549604 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.549577 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp" (OuterVolumeSpecName: "kube-api-access-bz8zp") pod "8b736fb2-7ef2-45de-8c7d-213d427fbac4" (UID: "8b736fb2-7ef2-45de-8c7d-213d427fbac4"). InnerVolumeSpecName "kube-api-access-bz8zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:35:22.649021 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:22.648993 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8zp\" (UniqueName: \"kubernetes.io/projected/8b736fb2-7ef2-45de-8c7d-213d427fbac4-kube-api-access-bz8zp\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:23.216192 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.216154 2561 generic.go:356] "Generic (PLEG): container finished" podID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" containerID="5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3" exitCode=0 Jul 22 01:35:23.216602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.216213 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-442ck" Jul 22 01:35:23.216602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.216242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-442ck" event={"ID":"8b736fb2-7ef2-45de-8c7d-213d427fbac4","Type":"ContainerDied","Data":"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3"} Jul 22 01:35:23.216602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.216294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-442ck" event={"ID":"8b736fb2-7ef2-45de-8c7d-213d427fbac4","Type":"ContainerDied","Data":"f525987c9d0fb7d8de0525b2d1b09239ca1f177be576ed0f2d9acb388233f57f"} Jul 22 01:35:23.216602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.216319 2561 scope.go:117] "RemoveContainer" containerID="5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3" Jul 22 01:35:23.225289 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.225270 2561 scope.go:117] "RemoveContainer" containerID="5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3" Jul 22 01:35:23.225559 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:35:23.225540 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3\": container with ID starting with 5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3 not found: ID does not exist" containerID="5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3" Jul 22 01:35:23.225629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.225565 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3"} err="failed to get container status \"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3\": rpc error: code = NotFound desc = could not find container \"5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3\": container with ID starting with 5caa93a5211d85d4430050099d6c0a8e7ae9239bc2f688ccde33f612f095a9b3 not found: ID does not exist" Jul 22 01:35:23.241216 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.241193 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:23.248122 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:23.248101 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-442ck"] Jul 22 01:35:24.097287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:24.097211 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" path="/var/lib/kubelet/pods/8b736fb2-7ef2-45de-8c7d-213d427fbac4/volumes" Jul 22 01:35:29.848853 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:29.848818 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:29.849252 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:29.848875 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:29.871041 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:29.871011 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:30.276429 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:30.276353 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xcm67" Jul 22 01:35:34.839646 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.839612 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc"] Jul 22 01:35:34.840104 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.839987 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" containerName="registry-server" Jul 22 01:35:34.840104 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.839999 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" containerName="registry-server" Jul 22 01:35:34.840104 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.840050 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b736fb2-7ef2-45de-8c7d-213d427fbac4" containerName="registry-server" Jul 22 01:35:34.845037 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.845020 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.847490 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.847473 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b826r\"" Jul 22 01:35:34.850103 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.850077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.850214 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.850116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.850214 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.850195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2cck\" (UniqueName: \"kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.855026 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.855003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc"] Jul 22 01:35:34.950620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.950582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.950620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.950621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.950907 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.950669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2cck\" (UniqueName: \"kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.951047 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.951020 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.951111 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.951051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:34.961158 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:34.961132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2cck\" (UniqueName: \"kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:35.154126 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.154044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:35.290465 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.290439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc"] Jul 22 01:35:35.292984 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:35.292959 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9a0cd9_6f7e_4655_b7e0_975297765d07.slice/crio-f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b WatchSource:0}: Error finding container f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b: Status 404 returned error can't find the container with id f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b Jul 22 01:35:35.601132 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.601099 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj"] Jul 22 01:35:35.604979 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.604960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.619416 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.619393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj"] Jul 22 01:35:35.657361 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.657338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.657470 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.657368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvf65\" (UniqueName: \"kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.657470 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.657417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.758468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.758437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.758600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.758525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.758600 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.758554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvf65\" (UniqueName: \"kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.758922 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.758901 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.758964 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.758939 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.768960 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.768937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvf65\" (UniqueName: \"kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:35.914307 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:35.914225 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:36.047620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.047591 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj"] Jul 22 01:35:36.049045 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:36.049013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8125e2c_e069_4b7a_bdd0_abe8ff50b1c1.slice/crio-4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a WatchSource:0}: Error finding container 4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a: Status 404 returned error can't find the container with id 4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a Jul 22 01:35:36.188032 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.187956 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf"] Jul 22 01:35:36.191436 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.191419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.201072 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.201051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf"] Jul 22 01:35:36.263374 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.263344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.263492 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.263402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.263492 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.263485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lb7v\" (UniqueName: \"kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.284841 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.284814 2561 generic.go:356] "Generic (PLEG): container finished" podID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerID="45a178fd31d57b1f19e79ebf621289393475152c18f0f62c3419d51766b81140" exitCode=0 Jul 22 01:35:36.284956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.284901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" event={"ID":"3e9a0cd9-6f7e-4655-b7e0-975297765d07","Type":"ContainerDied","Data":"45a178fd31d57b1f19e79ebf621289393475152c18f0f62c3419d51766b81140"} Jul 22 01:35:36.284956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.284951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" event={"ID":"3e9a0cd9-6f7e-4655-b7e0-975297765d07","Type":"ContainerStarted","Data":"f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b"} Jul 22 01:35:36.286572 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.286552 2561 generic.go:356] "Generic (PLEG): container finished" podID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerID="5e2de28e0323acd57da877989a7589905dc36b98a8027042265111d51c2e1f5d" exitCode=0 Jul 22 01:35:36.286662 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.286582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" event={"ID":"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1","Type":"ContainerDied","Data":"5e2de28e0323acd57da877989a7589905dc36b98a8027042265111d51c2e1f5d"} Jul 22 01:35:36.286662 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.286643 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" event={"ID":"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1","Type":"ContainerStarted","Data":"4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a"} Jul 22 01:35:36.364176 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.364147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.364339 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.364195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lb7v\" (UniqueName: \"kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.364339 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.364276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.364610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.364586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.364647 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.364611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.373456 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.373428 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lb7v\" (UniqueName: \"kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.543588 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.543517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:36.581414 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.581377 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw"] Jul 22 01:35:36.585937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.585913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.598243 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.598211 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw"] Jul 22 01:35:36.666175 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.666133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6sq\" (UniqueName: \"kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.666329 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.666180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.666329 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.666241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.681502 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.681478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf"] Jul 22 01:35:36.683704 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:36.683679 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40b065e_c5b5_40c0_8947_8367f0688a5a.slice/crio-c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e WatchSource:0}: Error finding container c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e: Status 404 returned error can't find the container with id c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e Jul 22 01:35:36.767524 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.767489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.767714 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.767594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6sq\" (UniqueName: \"kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.767714 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.767632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.767906 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.767884 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.768054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.768034 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.777871 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.777704 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6sq\" (UniqueName: \"kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:36.898903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:36.898871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:37.035967 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.035935 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw"] Jul 22 01:35:37.038482 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:37.038450 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766dacf5_8aaf_4d9a_abff_1c2853059232.slice/crio-782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3 WatchSource:0}: Error finding container 782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3: Status 404 returned error can't find the container with id 782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3 Jul 22 01:35:37.293224 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.293191 2561 generic.go:356] "Generic (PLEG): container finished" podID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerID="9cca3528da53eac1c77ac8bb7ad34605dc43d7e13dc8707625a54960b8820c8f" exitCode=0 Jul 22 01:35:37.293404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.293289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" event={"ID":"766dacf5-8aaf-4d9a-abff-1c2853059232","Type":"ContainerDied","Data":"9cca3528da53eac1c77ac8bb7ad34605dc43d7e13dc8707625a54960b8820c8f"} Jul 22 01:35:37.293404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.293349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" event={"ID":"766dacf5-8aaf-4d9a-abff-1c2853059232","Type":"ContainerStarted","Data":"782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3"} Jul 22 01:35:37.295011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.294987 2561 generic.go:356] "Generic (PLEG): container finished" podID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerID="c521b34c9839461d784f6b9401e580cfcb71e446104455f4e94e1649f54bf8d5" exitCode=0 Jul 22 01:35:37.295119 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.295043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" event={"ID":"c40b065e-c5b5-40c0-8947-8367f0688a5a","Type":"ContainerDied","Data":"c521b34c9839461d784f6b9401e580cfcb71e446104455f4e94e1649f54bf8d5"} Jul 22 01:35:37.295119 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:37.295071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" event={"ID":"c40b065e-c5b5-40c0-8947-8367f0688a5a","Type":"ContainerStarted","Data":"c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e"} Jul 22 01:35:38.302030 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:38.301947 2561 generic.go:356] "Generic (PLEG): container finished" podID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerID="cd288f3b73097a1701868e8d86ec42415c6a423696854442fcfe70b331ccc870" exitCode=0 Jul 22 01:35:38.302454 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:38.302037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" event={"ID":"3e9a0cd9-6f7e-4655-b7e0-975297765d07","Type":"ContainerDied","Data":"cd288f3b73097a1701868e8d86ec42415c6a423696854442fcfe70b331ccc870"} Jul 22 01:35:38.303911 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:38.303884 2561 generic.go:356] "Generic (PLEG): container finished" podID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerID="2233d27d945356ed1708c92a5781ffa40a8613760a88611a7f4a1546fb6baa6d" exitCode=0 Jul 22 01:35:38.304003 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:38.303923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" event={"ID":"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1","Type":"ContainerDied","Data":"2233d27d945356ed1708c92a5781ffa40a8613760a88611a7f4a1546fb6baa6d"} Jul 22 01:35:39.310998 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.310913 2561 generic.go:356] "Generic (PLEG): container finished" podID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerID="cc50dc92819c2dc829eab2f79bd6f9c2bd0705ae892b68f49e0368a56f94f770" exitCode=0 Jul 22 01:35:39.311404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.311005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" event={"ID":"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1","Type":"ContainerDied","Data":"cc50dc92819c2dc829eab2f79bd6f9c2bd0705ae892b68f49e0368a56f94f770"} Jul 22 01:35:39.312669 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.312647 2561 generic.go:356] "Generic (PLEG): container finished" podID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerID="c34437a647d3d9989c344975be85122f144baa689bfefd01b7eef47cddb821fd" exitCode=0 Jul 22 01:35:39.312731 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.312716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" event={"ID":"766dacf5-8aaf-4d9a-abff-1c2853059232","Type":"ContainerDied","Data":"c34437a647d3d9989c344975be85122f144baa689bfefd01b7eef47cddb821fd"} Jul 22 01:35:39.314444 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.314423 2561 generic.go:356] "Generic (PLEG): container finished" podID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerID="b7f0a151817b806df960559656857927340b92331b2f5476576ab81517f74703" exitCode=0 Jul 22 01:35:39.314554 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.314500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" event={"ID":"c40b065e-c5b5-40c0-8947-8367f0688a5a","Type":"ContainerDied","Data":"b7f0a151817b806df960559656857927340b92331b2f5476576ab81517f74703"} Jul 22 01:35:39.316592 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.316571 2561 generic.go:356] "Generic (PLEG): container finished" podID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerID="59055a49daed8b19585c42e668f942d4ae4ab8f774e564baf68a61e5a155a474" exitCode=0 Jul 22 01:35:39.316670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:39.316634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" event={"ID":"3e9a0cd9-6f7e-4655-b7e0-975297765d07","Type":"ContainerDied","Data":"59055a49daed8b19585c42e668f942d4ae4ab8f774e564baf68a61e5a155a474"} Jul 22 01:35:40.323957 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.323926 2561 generic.go:356] "Generic (PLEG): container finished" podID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerID="e715d58a2a1cf14e108510f981891a63c3251438b0eb3bfc1ad9d910e28b5665" exitCode=0 Jul 22 01:35:40.324372 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.323998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" event={"ID":"766dacf5-8aaf-4d9a-abff-1c2853059232","Type":"ContainerDied","Data":"e715d58a2a1cf14e108510f981891a63c3251438b0eb3bfc1ad9d910e28b5665"} Jul 22 01:35:40.325966 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.325941 2561 generic.go:356] "Generic (PLEG): container finished" podID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerID="81e1ae9e5411703c2f40b4ede724d4b878dd396a24e54ec1a2cb44b5dcfd505b" exitCode=0 Jul 22 01:35:40.326087 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.326017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" event={"ID":"c40b065e-c5b5-40c0-8947-8367f0688a5a","Type":"ContainerDied","Data":"81e1ae9e5411703c2f40b4ede724d4b878dd396a24e54ec1a2cb44b5dcfd505b"} Jul 22 01:35:40.456508 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.456479 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:40.491648 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.491620 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:40.501855 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.501833 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle\") pod \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " Jul 22 01:35:40.501976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.501939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvf65\" (UniqueName: \"kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65\") pod \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " Jul 22 01:35:40.501976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.501969 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util\") pod \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\" (UID: \"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1\") " Jul 22 01:35:40.502404 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.502378 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle" (OuterVolumeSpecName: "bundle") pod "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" (UID: "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:40.503974 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.503950 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65" (OuterVolumeSpecName: "kube-api-access-hvf65") pod "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" (UID: "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1"). InnerVolumeSpecName "kube-api-access-hvf65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:35:40.509835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.509797 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util" (OuterVolumeSpecName: "util") pod "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" (UID: "b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:40.602496 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602465 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle\") pod \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " Jul 22 01:35:40.602623 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602591 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2cck\" (UniqueName: \"kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck\") pod \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " Jul 22 01:35:40.602670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602631 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util\") pod \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\" (UID: \"3e9a0cd9-6f7e-4655-b7e0-975297765d07\") " Jul 22 01:35:40.602929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602909 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvf65\" (UniqueName: \"kubernetes.io/projected/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-kube-api-access-hvf65\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:40.602976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602936 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:40.602976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.602952 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:40.603061 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.603017 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle" (OuterVolumeSpecName: "bundle") pod "3e9a0cd9-6f7e-4655-b7e0-975297765d07" (UID: "3e9a0cd9-6f7e-4655-b7e0-975297765d07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:40.604612 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.604587 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck" (OuterVolumeSpecName: "kube-api-access-r2cck") pod "3e9a0cd9-6f7e-4655-b7e0-975297765d07" (UID: "3e9a0cd9-6f7e-4655-b7e0-975297765d07"). InnerVolumeSpecName "kube-api-access-r2cck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:35:40.608502 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.608477 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util" (OuterVolumeSpecName: "util") pod "3e9a0cd9-6f7e-4655-b7e0-975297765d07" (UID: "3e9a0cd9-6f7e-4655-b7e0-975297765d07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:40.703643 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.703613 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:40.703643 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.703639 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e9a0cd9-6f7e-4655-b7e0-975297765d07-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:40.703643 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:40.703649 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2cck\" (UniqueName: \"kubernetes.io/projected/3e9a0cd9-6f7e-4655-b7e0-975297765d07-kube-api-access-r2cck\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.332816 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.332786 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" Jul 22 01:35:41.333255 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.332790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc" event={"ID":"3e9a0cd9-6f7e-4655-b7e0-975297765d07","Type":"ContainerDied","Data":"f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b"} Jul 22 01:35:41.333255 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.332903 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f795f5e275784576c78da9b5c0aa98d5d3a04b282217c718be143f2ad08cc09b" Jul 22 01:35:41.334670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.334643 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" Jul 22 01:35:41.334787 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.334684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj" event={"ID":"b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1","Type":"ContainerDied","Data":"4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a"} Jul 22 01:35:41.334787 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.334718 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b0715bfdb14479823045e9bcbf4b5c9627c38e62a9b271bc5a030a0e5eaed4a" Jul 22 01:35:41.504261 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.504237 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:41.506242 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.506222 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:41.610629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610549 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle\") pod \"766dacf5-8aaf-4d9a-abff-1c2853059232\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " Jul 22 01:35:41.610629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610602 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6sq\" (UniqueName: \"kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq\") pod \"766dacf5-8aaf-4d9a-abff-1c2853059232\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " Jul 22 01:35:41.610842 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610640 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle\") pod \"c40b065e-c5b5-40c0-8947-8367f0688a5a\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " Jul 22 01:35:41.610842 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610720 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lb7v\" (UniqueName: \"kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v\") pod \"c40b065e-c5b5-40c0-8947-8367f0688a5a\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " Jul 22 01:35:41.610842 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610801 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util\") pod \"c40b065e-c5b5-40c0-8947-8367f0688a5a\" (UID: \"c40b065e-c5b5-40c0-8947-8367f0688a5a\") " Jul 22 01:35:41.610842 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.610826 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util\") pod \"766dacf5-8aaf-4d9a-abff-1c2853059232\" (UID: \"766dacf5-8aaf-4d9a-abff-1c2853059232\") " Jul 22 01:35:41.611296 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.611265 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle" (OuterVolumeSpecName: "bundle") pod "c40b065e-c5b5-40c0-8947-8367f0688a5a" (UID: "c40b065e-c5b5-40c0-8947-8367f0688a5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:41.611463 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.611318 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle" (OuterVolumeSpecName: "bundle") pod "766dacf5-8aaf-4d9a-abff-1c2853059232" (UID: "766dacf5-8aaf-4d9a-abff-1c2853059232"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:41.612982 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.612959 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v" (OuterVolumeSpecName: "kube-api-access-9lb7v") pod "c40b065e-c5b5-40c0-8947-8367f0688a5a" (UID: "c40b065e-c5b5-40c0-8947-8367f0688a5a"). InnerVolumeSpecName "kube-api-access-9lb7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:35:41.613139 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.613125 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq" (OuterVolumeSpecName: "kube-api-access-rv6sq") pod "766dacf5-8aaf-4d9a-abff-1c2853059232" (UID: "766dacf5-8aaf-4d9a-abff-1c2853059232"). InnerVolumeSpecName "kube-api-access-rv6sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:35:41.616937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.616909 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util" (OuterVolumeSpecName: "util") pod "c40b065e-c5b5-40c0-8947-8367f0688a5a" (UID: "c40b065e-c5b5-40c0-8947-8367f0688a5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:41.617304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.617282 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util" (OuterVolumeSpecName: "util") pod "766dacf5-8aaf-4d9a-abff-1c2853059232" (UID: "766dacf5-8aaf-4d9a-abff-1c2853059232"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:35:41.711722 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711691 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lb7v\" (UniqueName: \"kubernetes.io/projected/c40b065e-c5b5-40c0-8947-8367f0688a5a-kube-api-access-9lb7v\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.711722 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711718 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.711722 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711729 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-util\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.711935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711737 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/766dacf5-8aaf-4d9a-abff-1c2853059232-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.711935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711745 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6sq\" (UniqueName: \"kubernetes.io/projected/766dacf5-8aaf-4d9a-abff-1c2853059232-kube-api-access-rv6sq\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:41.711935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:41.711754 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c40b065e-c5b5-40c0-8947-8367f0688a5a-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:35:42.341145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.341105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" event={"ID":"766dacf5-8aaf-4d9a-abff-1c2853059232","Type":"ContainerDied","Data":"782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3"} Jul 22 01:35:42.341539 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.341163 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="782e655af9cb74ef2f2248f6e0539ed03d664f824193565cf1899756d4bf94c3" Jul 22 01:35:42.341539 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.341119 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw" Jul 22 01:35:42.343226 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.343198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" event={"ID":"c40b065e-c5b5-40c0-8947-8367f0688a5a","Type":"ContainerDied","Data":"c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e"} Jul 22 01:35:42.343345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.343228 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf" Jul 22 01:35:42.343345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:42.343244 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2b0abffe7ac3703011317209a68e3e84beb0dd5d04ac2a23e1fe9fa6824304e" Jul 22 01:35:44.390032 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:44.390004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:44.458880 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:44.458846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.540701 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9fb54cfb-tdk9n"] Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541444 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541463 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541486 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541496 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541514 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541523 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541544 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541553 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541584 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541592 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541605 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541619 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541631 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541639 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541662 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541670 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="pull" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541686 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541694 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541713 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541721 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541734 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541742 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541778 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541787 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="util" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541953 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541972 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40b065e-c5b5-40c0-8947-8367f0688a5a" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.541983 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="766dacf5-8aaf-4d9a-abff-1c2853059232" containerName="extract" Jul 22 01:35:45.544311 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.542001 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9a0cd9-6f7e-4655-b7e0-975297765d07" containerName="extract" Jul 22 01:35:45.546860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.546843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.566243 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.566220 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fb54cfb-tdk9n"] Jul 22 01:35:45.643716 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.643686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:45.645850 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.645828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-console-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.645924 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.645860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-oauth-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.645924 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.645879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-trusted-ca-bundle\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.645924 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.645903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-service-ca\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.646027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.645978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.646061 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.646030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-oauth-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.646061 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.646050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqjf\" (UniqueName: \"kubernetes.io/projected/9bc7a9fb-58f3-4295-8e17-464afd889676-kube-api-access-gwqjf\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.728237 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.728201 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:45.747375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-console-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747482 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-oauth-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747482 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-trusted-ca-bundle\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747612 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-service-ca\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747664 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747719 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-oauth-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.747719 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.747710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqjf\" (UniqueName: \"kubernetes.io/projected/9bc7a9fb-58f3-4295-8e17-464afd889676-kube-api-access-gwqjf\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.748332 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.748300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-console-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.748422 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.748371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-oauth-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.748422 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.748381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-service-ca\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.748498 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.748479 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc7a9fb-58f3-4295-8e17-464afd889676-trusted-ca-bundle\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.749868 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.749843 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-oauth-config\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.750127 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.750103 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc7a9fb-58f3-4295-8e17-464afd889676-console-serving-cert\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.757320 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.757295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqjf\" (UniqueName: \"kubernetes.io/projected/9bc7a9fb-58f3-4295-8e17-464afd889676-kube-api-access-gwqjf\") pod \"console-9fb54cfb-tdk9n\" (UID: \"9bc7a9fb-58f3-4295-8e17-464afd889676\") " pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.824547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.824466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:45.855695 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.855662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:45.988063 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:45.988041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fb54cfb-tdk9n"] Jul 22 01:35:45.990522 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:45.990495 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc7a9fb_58f3_4295_8e17_464afd889676.slice/crio-dae92cf46ee420bc15e3a7e324d960350d66fd4e6046a01ab41e431e452ce411 WatchSource:0}: Error finding container dae92cf46ee420bc15e3a7e324d960350d66fd4e6046a01ab41e431e452ce411: Status 404 returned error can't find the container with id dae92cf46ee420bc15e3a7e324d960350d66fd4e6046a01ab41e431e452ce411 Jul 22 01:35:46.294559 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:46.294523 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:46.366349 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:46.366309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fb54cfb-tdk9n" event={"ID":"9bc7a9fb-58f3-4295-8e17-464afd889676","Type":"ContainerStarted","Data":"7207e3f3456356c47a2a89fad16b94570c5296616ab80a401f875b03f8b48fe7"} Jul 22 01:35:46.366503 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:46.366364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fb54cfb-tdk9n" event={"ID":"9bc7a9fb-58f3-4295-8e17-464afd889676","Type":"ContainerStarted","Data":"dae92cf46ee420bc15e3a7e324d960350d66fd4e6046a01ab41e431e452ce411"} Jul 22 01:35:46.390575 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:46.390525 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9fb54cfb-tdk9n" podStartSLOduration=1.390507798 podStartE2EDuration="1.390507798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:35:46.388423751 +0000 UTC m=+464.443132379" watchObservedRunningTime="2026-07-22 01:35:46.390507798 +0000 UTC m=+464.445216426" Jul 22 01:35:46.393641 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:46.393619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:48.274644 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:48.274611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:48.957932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:48.957899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:52.465494 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.465457 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc"] Jul 22 01:35:52.472016 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.471995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:52.474948 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.474923 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-l8bsg\"" Jul 22 01:35:52.482329 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.482308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc"] Jul 22 01:35:52.611034 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.610997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vbht\" (UniqueName: \"kubernetes.io/projected/7f794a17-fb6f-466f-9022-b7baccb7f87e-kube-api-access-6vbht\") pod \"authorino-operator-75cc8d5cb7-pc6dc\" (UID: \"7f794a17-fb6f-466f-9022-b7baccb7f87e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:52.711929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.711894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vbht\" (UniqueName: \"kubernetes.io/projected/7f794a17-fb6f-466f-9022-b7baccb7f87e-kube-api-access-6vbht\") pod \"authorino-operator-75cc8d5cb7-pc6dc\" (UID: \"7f794a17-fb6f-466f-9022-b7baccb7f87e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:52.737603 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.737533 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vbht\" (UniqueName: \"kubernetes.io/projected/7f794a17-fb6f-466f-9022-b7baccb7f87e-kube-api-access-6vbht\") pod \"authorino-operator-75cc8d5cb7-pc6dc\" (UID: \"7f794a17-fb6f-466f-9022-b7baccb7f87e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:52.783497 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.783465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:52.931355 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:52.931330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc"] Jul 22 01:35:52.932241 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:52.932221 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f794a17_fb6f_466f_9022_b7baccb7f87e.slice/crio-71016d9bed49afbcbfa6e619d63d048d90436563f2b7877e2fc6f55aed17c8ca WatchSource:0}: Error finding container 71016d9bed49afbcbfa6e619d63d048d90436563f2b7877e2fc6f55aed17c8ca: Status 404 returned error can't find the container with id 71016d9bed49afbcbfa6e619d63d048d90436563f2b7877e2fc6f55aed17c8ca Jul 22 01:35:53.168776 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:53.168730 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:53.404194 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:53.404164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" event={"ID":"7f794a17-fb6f-466f-9022-b7baccb7f87e","Type":"ContainerStarted","Data":"71016d9bed49afbcbfa6e619d63d048d90436563f2b7877e2fc6f55aed17c8ca"} Jul 22 01:35:54.208023 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:54.207982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:54.329269 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:54.329230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:55.418385 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.418347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" event={"ID":"7f794a17-fb6f-466f-9022-b7baccb7f87e","Type":"ContainerStarted","Data":"47a6f56da5a7f08b463231ba38b4df757af2772ea1579be8d91dda4c47215ba2"} Jul 22 01:35:55.418819 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.418407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:35:55.856421 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.856380 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:55.856608 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.856448 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:55.861842 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.861821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:55.913686 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:55.913638 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" podStartSLOduration=1.639878896 podStartE2EDuration="3.913623629s" totalImagesPullingTime="2.273744733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:35:55.4453268 +0000 UTC m=+473.500035429" watchObservedRunningTime="2026-07-22 01:35:55.913623629 +0000 UTC m=+473.968332256" Jul 22 01:35:56.427532 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:56.427503 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9fb54cfb-tdk9n" Jul 22 01:35:56.514835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:56.514800 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:35:56.804796 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:56.804702 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:56.894067 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:56.894034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:56.999688 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:56.999656 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:57.338527 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.338486 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q"] Jul 22 01:35:57.342080 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.342056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.347738 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.347717 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f7tp2\"" Jul 22 01:35:57.358864 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.358828 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q"] Jul 22 01:35:57.458744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.458712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8ncj\" (UniqueName: \"kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.459190 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.458831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.559812 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.559751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8ncj\" (UniqueName: \"kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.559980 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.559858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.560611 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.560585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.573547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.573523 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8ncj\" (UniqueName: \"kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.651519 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.651439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:35:57.797440 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.797414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q"] Jul 22 01:35:57.799574 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:35:57.799551 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05549c52_757c_4037_a47a_db7c8c8f8895.slice/crio-c9b76874c44bfca9286052bb9ac74110b00049b656d378c80880e65d194c082c WatchSource:0}: Error finding container c9b76874c44bfca9286052bb9ac74110b00049b656d378c80880e65d194c082c: Status 404 returned error can't find the container with id c9b76874c44bfca9286052bb9ac74110b00049b656d378c80880e65d194c082c Jul 22 01:35:57.960405 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:57.960317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:35:58.435046 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:58.435012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" event={"ID":"05549c52-757c-4037-a47a-db7c8c8f8895","Type":"ContainerStarted","Data":"c9b76874c44bfca9286052bb9ac74110b00049b656d378c80880e65d194c082c"} Jul 22 01:35:59.781872 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:35:59.781786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:00.080827 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:00.080799 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:02.182858 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:02.182815 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:03.466631 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:03.466591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" event={"ID":"05549c52-757c-4037-a47a-db7c8c8f8895","Type":"ContainerStarted","Data":"19c3201419cdfca8beb166cc9bea44725e7753c56b7a7bb429b2307d029f7f1c"} Jul 22 01:36:03.467099 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:03.466725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:03.487070 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:03.487020 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" podStartSLOduration=1.210395325 podStartE2EDuration="6.487006811s" totalImagesPullingTime="5.276611486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:03.485521317 +0000 UTC m=+481.540229944" watchObservedRunningTime="2026-07-22 01:36:03.487006811 +0000 UTC m=+481.541715437" Jul 22 01:36:03.751254 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:03.751152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:03.815419 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:03.815383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:04.168562 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:04.168527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:04.250047 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:04.250007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:05.768968 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:05.768916 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:05.944976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:05.944929 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:06.426436 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:06.426407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pc6dc" Jul 22 01:36:08.395057 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:08.395029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:08.951860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:08.951819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:13.852278 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:13.852244 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:13.920305 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:13.920274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:14.474607 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:14.474576 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.115193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.115150 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:16.204238 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.204200 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:16.413734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.413645 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q"] Jul 22 01:36:16.413908 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.413871 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" containerName="manager" containerID="cri-o://19c3201419cdfca8beb166cc9bea44725e7753c56b7a7bb429b2307d029f7f1c" gracePeriod=2 Jul 22 01:36:16.434494 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.434467 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q"] Jul 22 01:36:16.444515 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:16.444479 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"05549c52-757c-4037-a47a-db7c8c8f8895\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zf99q\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.458628 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.458598 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:16.459027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.459012 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" containerName="manager" Jul 22 01:36:16.459027 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.459028 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" containerName="manager" Jul 22 01:36:16.459157 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.459078 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" containerName="manager" Jul 22 01:36:16.461128 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.461108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.482193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.482165 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:16.505847 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:16.505804 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.535516 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.535489 2561 generic.go:356] "Generic (PLEG): container finished" podID="05549c52-757c-4037-a47a-db7c8c8f8895" containerID="19c3201419cdfca8beb166cc9bea44725e7753c56b7a7bb429b2307d029f7f1c" exitCode=0 Jul 22 01:36:16.626305 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.626273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpdxh\" (UniqueName: \"kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.626469 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.626393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.631254 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.631230 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:36:16.634190 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.634165 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.655800 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.655778 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.673309 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.673248 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:36:16.700563 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:16.700533 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.703863 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:16.703841 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:16.727313 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.727282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.727396 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.727359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpdxh\" (UniqueName: \"kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.727744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.727727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.748904 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.748875 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpdxh\" (UniqueName: \"kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6xpxz\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.793537 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.793505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:16.827782 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.827730 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume\") pod \"05549c52-757c-4037-a47a-db7c8c8f8895\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " Jul 22 01:36:16.827923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.827806 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8ncj\" (UniqueName: \"kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj\") pod \"05549c52-757c-4037-a47a-db7c8c8f8895\" (UID: \"05549c52-757c-4037-a47a-db7c8c8f8895\") " Jul 22 01:36:16.828036 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.828011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.828099 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.828087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9cf\" (UniqueName: \"kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.828277 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.828256 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05549c52-757c-4037-a47a-db7c8c8f8895" (UID: "05549c52-757c-4037-a47a-db7c8c8f8895"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:36:16.829824 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.829794 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj" (OuterVolumeSpecName: "kube-api-access-g8ncj") pod "05549c52-757c-4037-a47a-db7c8c8f8895" (UID: "05549c52-757c-4037-a47a-db7c8c8f8895"). InnerVolumeSpecName "kube-api-access-g8ncj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:36:16.929207 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.929130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.929207 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.929188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9cf\" (UniqueName: \"kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.929381 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.929273 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8ncj\" (UniqueName: \"kubernetes.io/projected/05549c52-757c-4037-a47a-db7c8c8f8895-kube-api-access-g8ncj\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:16.929381 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.929288 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05549c52-757c-4037-a47a-db7c8c8f8895-extensions-socket-volume\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:16.929510 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.929493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.938415 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.938392 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:16.940377 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:36:16.940351 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb68636_5681_4887_9618_e962db142566.slice/crio-072dfff5f6fe78ed4f2e9824ef859820bc69d3565fa7ce425497f1dfa861ce4d WatchSource:0}: Error finding container 072dfff5f6fe78ed4f2e9824ef859820bc69d3565fa7ce425497f1dfa861ce4d: Status 404 returned error can't find the container with id 072dfff5f6fe78ed4f2e9824ef859820bc69d3565fa7ce425497f1dfa861ce4d Jul 22 01:36:16.947257 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.947232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9cf\" (UniqueName: \"kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf\") pod \"kuadrant-operator-controller-manager-86878c769f-kmpp8\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:16.953529 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:16.953511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:17.110982 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.110950 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:36:17.114207 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:36:17.114180 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ccc5c6_947c_41fe_b30f_469dae9c5fb9.slice/crio-2a6cdd10c0ee2cd16f6568913ad4308e4ec901d515b752d81e657d232c610848 WatchSource:0}: Error finding container 2a6cdd10c0ee2cd16f6568913ad4308e4ec901d515b752d81e657d232c610848: Status 404 returned error can't find the container with id 2a6cdd10c0ee2cd16f6568913ad4308e4ec901d515b752d81e657d232c610848 Jul 22 01:36:17.542193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.542161 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" event={"ID":"1fb68636-5681-4887-9618-e962db142566","Type":"ContainerStarted","Data":"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf"} Jul 22 01:36:17.542868 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.542217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" event={"ID":"1fb68636-5681-4887-9618-e962db142566","Type":"ContainerStarted","Data":"072dfff5f6fe78ed4f2e9824ef859820bc69d3565fa7ce425497f1dfa861ce4d"} Jul 22 01:36:17.542868 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.542315 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:17.543607 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.543587 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:17.543665 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.543621 2561 scope.go:117] "RemoveContainer" containerID="19c3201419cdfca8beb166cc9bea44725e7753c56b7a7bb429b2307d029f7f1c" Jul 22 01:36:17.545159 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.545135 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" event={"ID":"80ccc5c6-947c-41fe-b30f-469dae9c5fb9","Type":"ContainerStarted","Data":"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d"} Jul 22 01:36:17.545227 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.545184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" event={"ID":"80ccc5c6-947c-41fe-b30f-469dae9c5fb9","Type":"ContainerStarted","Data":"2a6cdd10c0ee2cd16f6568913ad4308e4ec901d515b752d81e657d232c610848"} Jul 22 01:36:17.545279 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.545225 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:17.573803 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.573733 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" podStartSLOduration=1.573716986 podStartE2EDuration="1.573716986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:17.571787594 +0000 UTC m=+495.626496222" watchObservedRunningTime="2026-07-22 01:36:17.573716986 +0000 UTC m=+495.628425613" Jul 22 01:36:17.574080 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:17.574054 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:17.598592 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:17.598544 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" podStartSLOduration=1.598530097 podStartE2EDuration="1.598530097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:17.596905212 +0000 UTC m=+495.651613840" watchObservedRunningTime="2026-07-22 01:36:17.598530097 +0000 UTC m=+495.653238723" Jul 22 01:36:17.598889 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:17.598865 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zf99q\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zf99q" Jul 22 01:36:18.097530 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:18.097486 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05549c52-757c-4037-a47a-db7c8c8f8895" path="/var/lib/kubelet/pods/05549c52-757c-4037-a47a-db7c8c8f8895/volumes" Jul 22 01:36:20.810696 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:20.810667 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:20.985317 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:20.985276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:21.537152 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.537103 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ccbfdf4c5-7zkgr" podUID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" containerName="console" containerID="cri-o://c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4" gracePeriod=15 Jul 22 01:36:21.787660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.787599 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:36:21.866860 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.866829 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.866869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.866917 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.866967 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdqfj\" (UniqueName: \"kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.866993 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867034 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867281 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867071 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config\") pod \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\" (UID: \"2d1de16f-4b44-45c2-9c39-ec9eaad97e03\") " Jul 22 01:36:21.867617 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867295 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:36:21.867617 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867382 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-trusted-ca-bundle\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.867617 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867370 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:36:21.867617 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867548 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config" (OuterVolumeSpecName: "console-config") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:36:21.867906 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.867879 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:36:21.869207 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.869179 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:36:21.869207 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.869196 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:36:21.869306 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.869194 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj" (OuterVolumeSpecName: "kube-api-access-hdqfj") pod "2d1de16f-4b44-45c2-9c39-ec9eaad97e03" (UID: "2d1de16f-4b44-45c2-9c39-ec9eaad97e03"). InnerVolumeSpecName "kube-api-access-hdqfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:36:21.968051 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968009 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-service-ca\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.968051 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968044 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-oauth-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.968051 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968058 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdqfj\" (UniqueName: \"kubernetes.io/projected/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-kube-api-access-hdqfj\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.968290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968070 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.968290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968082 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-oauth-serving-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:21.968290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:21.968093 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d1de16f-4b44-45c2-9c39-ec9eaad97e03-console-config\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:22.577228 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.577139 2561 generic.go:356] "Generic (PLEG): container finished" podID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" containerID="c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4" exitCode=0 Jul 22 01:36:22.577228 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.577187 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbfdf4c5-7zkgr" Jul 22 01:36:22.577228 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.577217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbfdf4c5-7zkgr" event={"ID":"2d1de16f-4b44-45c2-9c39-ec9eaad97e03","Type":"ContainerDied","Data":"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4"} Jul 22 01:36:22.577468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.577272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbfdf4c5-7zkgr" event={"ID":"2d1de16f-4b44-45c2-9c39-ec9eaad97e03","Type":"ContainerDied","Data":"d26997143aa20a12ed74eec875123b1a6072e8412009093a7f158da672baf4f8"} Jul 22 01:36:22.577468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.577293 2561 scope.go:117] "RemoveContainer" containerID="c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4" Jul 22 01:36:22.586183 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.586163 2561 scope.go:117] "RemoveContainer" containerID="c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4" Jul 22 01:36:22.586420 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:22.586402 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4\": container with ID starting with c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4 not found: ID does not exist" containerID="c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4" Jul 22 01:36:22.586468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.586428 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4"} err="failed to get container status \"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4\": rpc error: code = NotFound desc = could not find container \"c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4\": container with ID starting with c6d7028e13ca528b6bf77f77ad50aadaa1496c8af322878ce09ebb0c7f7684d4 not found: ID does not exist" Jul 22 01:36:22.597418 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.597393 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:36:22.603368 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:22.603347 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ccbfdf4c5-7zkgr"] Jul 22 01:36:24.097326 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:24.097293 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" path="/var/lib/kubelet/pods/2d1de16f-4b44-45c2-9c39-ec9eaad97e03/volumes" Jul 22 01:36:24.568827 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:24.568724 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:24.669834 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:24.669799 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:24.963407 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:24.963377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:25.024580 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:25.024549 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:25.496877 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:25.496829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:28.553613 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.553581 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:28.554043 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.553645 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:36:28.681109 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.681077 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:28.681276 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.681242 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" podUID="1fb68636-5681-4887-9618-e962db142566" containerName="manager" containerID="cri-o://bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf" gracePeriod=10 Jul 22 01:36:28.810263 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.810197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:28.928873 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.928842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:28.937689 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:28.937671 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:29.026042 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.026016 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpdxh\" (UniqueName: \"kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh\") pod \"1fb68636-5681-4887-9618-e962db142566\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " Jul 22 01:36:29.026155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.026051 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume\") pod \"1fb68636-5681-4887-9618-e962db142566\" (UID: \"1fb68636-5681-4887-9618-e962db142566\") " Jul 22 01:36:29.026470 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.026446 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1fb68636-5681-4887-9618-e962db142566" (UID: "1fb68636-5681-4887-9618-e962db142566"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:36:29.028153 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.028131 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh" (OuterVolumeSpecName: "kube-api-access-vpdxh") pod "1fb68636-5681-4887-9618-e962db142566" (UID: "1fb68636-5681-4887-9618-e962db142566"). InnerVolumeSpecName "kube-api-access-vpdxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:36:29.126578 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.126553 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpdxh\" (UniqueName: \"kubernetes.io/projected/1fb68636-5681-4887-9618-e962db142566-kube-api-access-vpdxh\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:29.126578 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.126576 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1fb68636-5681-4887-9618-e962db142566-extensions-socket-volume\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:36:29.616714 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.616679 2561 generic.go:356] "Generic (PLEG): container finished" podID="1fb68636-5681-4887-9618-e962db142566" containerID="bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf" exitCode=0 Jul 22 01:36:29.616714 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.616719 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" Jul 22 01:36:29.617219 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.616716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" event={"ID":"1fb68636-5681-4887-9618-e962db142566","Type":"ContainerDied","Data":"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf"} Jul 22 01:36:29.617219 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.616828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz" event={"ID":"1fb68636-5681-4887-9618-e962db142566","Type":"ContainerDied","Data":"072dfff5f6fe78ed4f2e9824ef859820bc69d3565fa7ce425497f1dfa861ce4d"} Jul 22 01:36:29.617219 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.616854 2561 scope.go:117] "RemoveContainer" containerID="bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf" Jul 22 01:36:29.626296 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.626274 2561 scope.go:117] "RemoveContainer" containerID="bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf" Jul 22 01:36:29.626534 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:36:29.626518 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf\": container with ID starting with bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf not found: ID does not exist" containerID="bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf" Jul 22 01:36:29.626582 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.626543 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf"} err="failed to get container status \"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf\": rpc error: code = NotFound desc = could not find container \"bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf\": container with ID starting with bd8a3f3d8f0f7b45d74e4ac9328642c7ce706f85cb2a118c3402e2231600badf not found: ID does not exist" Jul 22 01:36:29.648172 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.648146 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:29.659896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:29.659871 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6xpxz"] Jul 22 01:36:30.097249 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:30.097223 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb68636-5681-4887-9618-e962db142566" path="/var/lib/kubelet/pods/1fb68636-5681-4887-9618-e962db142566/volumes" Jul 22 01:36:33.082215 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:33.082182 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:34.673127 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:34.673099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:34.769802 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:34.768956 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:39.424670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:39.424631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:39.527622 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:39.527591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:45.269073 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269039 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh"] Jul 22 01:36:45.269468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269430 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb68636-5681-4887-9618-e962db142566" containerName="manager" Jul 22 01:36:45.269468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269442 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb68636-5681-4887-9618-e962db142566" containerName="manager" Jul 22 01:36:45.269468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269468 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" containerName="console" Jul 22 01:36:45.269597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269473 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" containerName="console" Jul 22 01:36:45.269597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269522 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d1de16f-4b44-45c2-9c39-ec9eaad97e03" containerName="console" Jul 22 01:36:45.269597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.269533 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb68636-5681-4887-9618-e962db142566" containerName="manager" Jul 22 01:36:45.272629 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.272609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.275055 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.275032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ffnwb\"" Jul 22 01:36:45.284207 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.284182 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh"] Jul 22 01:36:45.291424 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.291390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:45.368535 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99sf\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-kube-api-access-w99sf\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368887 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368887 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368887 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.368984 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.368898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.393740 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.393714 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:45.470323 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470323 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470837 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w99sf\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-kube-api-access-w99sf\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470837 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.470837 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.471004 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470878 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.471004 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.470982 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.471130 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.471017 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.471130 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.471125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.471222 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.471169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.472660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.472635 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.472980 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.472959 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.478825 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.478802 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.478956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.478934 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99sf\" (UniqueName: \"kubernetes.io/projected/5a61535e-3454-4c25-9cbb-0ac5afe0fc80-kube-api-access-w99sf\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7nzh\" (UID: \"5a61535e-3454-4c25-9cbb-0ac5afe0fc80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.584000 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.583964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:45.730474 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.730444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh"] Jul 22 01:36:45.733912 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:36:45.733880 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a61535e_3454_4c25_9cbb_0ac5afe0fc80.slice/crio-a306cd27caa48ae95ffd0087412a74677092678402fa0996e28d98ccd2d5e328 WatchSource:0}: Error finding container a306cd27caa48ae95ffd0087412a74677092678402fa0996e28d98ccd2d5e328: Status 404 returned error can't find the container with id a306cd27caa48ae95ffd0087412a74677092678402fa0996e28d98ccd2d5e328 Jul 22 01:36:45.736016 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.735987 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:36:45.736089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.736049 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:36:45.736089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:45.736080 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:36:46.708267 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:46.708225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" event={"ID":"5a61535e-3454-4c25-9cbb-0ac5afe0fc80","Type":"ContainerStarted","Data":"ed326ed610feb76bc1f274dd6e46fffd1d6efd1ac36924c58d49899bc49e67d8"} Jul 22 01:36:46.708668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:46.708286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" event={"ID":"5a61535e-3454-4c25-9cbb-0ac5afe0fc80","Type":"ContainerStarted","Data":"a306cd27caa48ae95ffd0087412a74677092678402fa0996e28d98ccd2d5e328"} Jul 22 01:36:46.733432 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:46.733379 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" podStartSLOduration=1.733363577 podStartE2EDuration="1.733363577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:46.730678366 +0000 UTC m=+524.785386994" watchObservedRunningTime="2026-07-22 01:36:46.733363577 +0000 UTC m=+524.788072204" Jul 22 01:36:47.584495 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:47.584459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:47.589141 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:47.589117 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:47.714241 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:47.714209 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:47.715082 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:47.715066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:36:48.280092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.280052 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:36:48.283127 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.283103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.285778 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.285745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b826r\"" Jul 22 01:36:48.285778 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.285753 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 01:36:48.295546 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.295522 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:36:48.326252 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.326213 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:36:48.399002 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.398936 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea738949-49f6-41d4-a766-a1c46714745e-config-file\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.399195 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.399087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv68n\" (UniqueName: \"kubernetes.io/projected/ea738949-49f6-41d4-a766-a1c46714745e-kube-api-access-pv68n\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.500122 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.500087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv68n\" (UniqueName: \"kubernetes.io/projected/ea738949-49f6-41d4-a766-a1c46714745e-kube-api-access-pv68n\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.500303 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.500137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea738949-49f6-41d4-a766-a1c46714745e-config-file\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.500756 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.500738 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea738949-49f6-41d4-a766-a1c46714745e-config-file\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.510559 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.510526 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:48.510694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.510603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv68n\" (UniqueName: \"kubernetes.io/projected/ea738949-49f6-41d4-a766-a1c46714745e-kube-api-access-pv68n\") pod \"limitador-limitador-54d6d988d5-dksw5\" (UID: \"ea738949-49f6-41d4-a766-a1c46714745e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.595293 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.595258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:48.609723 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.609689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:48.682575 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.682464 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:36:48.736230 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.736204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:36:48.738144 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:36:48.738114 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea738949_49f6_41d4_a766_a1c46714745e.slice/crio-33e02050fd8ab7263125d6c8c23535968b7e41eb6c5698d49a6f14f624a94fa7 WatchSource:0}: Error finding container 33e02050fd8ab7263125d6c8c23535968b7e41eb6c5698d49a6f14f624a94fa7: Status 404 returned error can't find the container with id 33e02050fd8ab7263125d6c8c23535968b7e41eb6c5698d49a6f14f624a94fa7 Jul 22 01:36:48.773380 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.773338 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:36:48.776810 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.776787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:36:48.779549 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.779528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cwvnk\"" Jul 22 01:36:48.786697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.786669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:36:48.903068 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:48.902979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdkt\" (UniqueName: \"kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt\") pod \"authorino-75d556bd77-9vbsc\" (UID: \"1d8e8111-a9df-4674-8281-837f47b584d7\") " pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:36:49.003836 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.003799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdkt\" (UniqueName: \"kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt\") pod \"authorino-75d556bd77-9vbsc\" (UID: \"1d8e8111-a9df-4674-8281-837f47b584d7\") " pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:36:49.013512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.013479 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdkt\" (UniqueName: \"kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt\") pod \"authorino-75d556bd77-9vbsc\" (UID: \"1d8e8111-a9df-4674-8281-837f47b584d7\") " pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:36:49.087955 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.087921 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:36:49.223596 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.223571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:36:49.225286 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:36:49.225260 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d8e8111_a9df_4674_8281_837f47b584d7.slice/crio-7a8ca525a87e3a6cd6bd824baa8d27621e461eb2dbcda596990db9f1d91502bb WatchSource:0}: Error finding container 7a8ca525a87e3a6cd6bd824baa8d27621e461eb2dbcda596990db9f1d91502bb: Status 404 returned error can't find the container with id 7a8ca525a87e3a6cd6bd824baa8d27621e461eb2dbcda596990db9f1d91502bb Jul 22 01:36:49.730749 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.730705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9vbsc" event={"ID":"1d8e8111-a9df-4674-8281-837f47b584d7","Type":"ContainerStarted","Data":"7a8ca525a87e3a6cd6bd824baa8d27621e461eb2dbcda596990db9f1d91502bb"} Jul 22 01:36:49.732965 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:49.732935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" event={"ID":"ea738949-49f6-41d4-a766-a1c46714745e","Type":"ContainerStarted","Data":"33e02050fd8ab7263125d6c8c23535968b7e41eb6c5698d49a6f14f624a94fa7"} Jul 22 01:36:53.762528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:53.762418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9vbsc" event={"ID":"1d8e8111-a9df-4674-8281-837f47b584d7","Type":"ContainerStarted","Data":"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90"} Jul 22 01:36:53.764116 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:53.764088 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" event={"ID":"ea738949-49f6-41d4-a766-a1c46714745e","Type":"ContainerStarted","Data":"043fd881008c025a9b94b489c996a09e9c1b1b8d8cf591cfcd289de691fb0f04"} Jul 22 01:36:53.764224 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:53.764160 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:36:53.780285 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:53.780243 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9vbsc" podStartSLOduration=1.652895555 podStartE2EDuration="5.780229365s" totalImagesPullingTime="4.12733381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:53.778010553 +0000 UTC m=+531.832719180" watchObservedRunningTime="2026-07-22 01:36:53.780229365 +0000 UTC m=+531.834937991" Jul 22 01:36:53.798232 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:36:53.798184 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" podStartSLOduration=1.191914787 podStartE2EDuration="5.798168438s" totalImagesPullingTime="4.606253651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:53.796818805 +0000 UTC m=+531.851527423" watchObservedRunningTime="2026-07-22 01:36:53.798168438 +0000 UTC m=+531.852877065" Jul 22 01:37:00.312505 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:00.312469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:04.771290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:04.771259 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dksw5" Jul 22 01:37:09.048495 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:09.048462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:09.143259 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:09.143223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:09.706705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:09.706673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:22.725320 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:22.725276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:22.889528 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:22.889495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:24.523082 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.523048 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:37:24.523468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.523240 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9vbsc" podUID="1d8e8111-a9df-4674-8281-837f47b584d7" containerName="authorino" containerID="cri-o://d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90" gracePeriod=30 Jul 22 01:37:24.784715 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.784657 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:37:24.824570 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.824540 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htdkt\" (UniqueName: \"kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt\") pod \"1d8e8111-a9df-4674-8281-837f47b584d7\" (UID: \"1d8e8111-a9df-4674-8281-837f47b584d7\") " Jul 22 01:37:24.826574 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.826547 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt" (OuterVolumeSpecName: "kube-api-access-htdkt") pod "1d8e8111-a9df-4674-8281-837f47b584d7" (UID: "1d8e8111-a9df-4674-8281-837f47b584d7"). InnerVolumeSpecName "kube-api-access-htdkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:37:24.925861 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.925828 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htdkt\" (UniqueName: \"kubernetes.io/projected/1d8e8111-a9df-4674-8281-837f47b584d7-kube-api-access-htdkt\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:37:24.936468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.936440 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d8e8111-a9df-4674-8281-837f47b584d7" containerID="d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90" exitCode=0 Jul 22 01:37:24.936610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.936475 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9vbsc" Jul 22 01:37:24.936610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.936522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9vbsc" event={"ID":"1d8e8111-a9df-4674-8281-837f47b584d7","Type":"ContainerDied","Data":"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90"} Jul 22 01:37:24.936610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.936563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9vbsc" event={"ID":"1d8e8111-a9df-4674-8281-837f47b584d7","Type":"ContainerDied","Data":"7a8ca525a87e3a6cd6bd824baa8d27621e461eb2dbcda596990db9f1d91502bb"} Jul 22 01:37:24.936610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.936583 2561 scope.go:117] "RemoveContainer" containerID="d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90" Jul 22 01:37:24.945871 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.945853 2561 scope.go:117] "RemoveContainer" containerID="d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90" Jul 22 01:37:24.946126 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:37:24.946107 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90\": container with ID starting with d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90 not found: ID does not exist" containerID="d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90" Jul 22 01:37:24.946192 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.946133 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90"} err="failed to get container status \"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90\": rpc error: code = NotFound desc = could not find container \"d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90\": container with ID starting with d004152db6aef65b612455749c8e9afd8e3de9fc33692314841c0f0de507dc90 not found: ID does not exist" Jul 22 01:37:24.967732 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.967705 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:37:24.975390 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:24.975367 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9vbsc"] Jul 22 01:37:26.096787 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:26.096742 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8e8111-a9df-4674-8281-837f47b584d7" path="/var/lib/kubelet/pods/1d8e8111-a9df-4674-8281-837f47b584d7/volumes" Jul 22 01:37:29.773461 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:29.773396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:29.910000 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:29.909972 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:29.986506 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:29.986474 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:30.723684 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:30.723647 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:33.245037 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:33.245002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:37:33.346711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:37:33.346681 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:03.083285 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:03.083251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:38:03.086670 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:03.086644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:38:05.321597 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:05.321558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:06.738400 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:06.738359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:38:07.919740 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:07.919700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:14.189980 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.189901 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a61535e-3454-4c25-9cbb-0ac5afe0fc80" containerID="ed326ed610feb76bc1f274dd6e46fffd1d6efd1ac36924c58d49899bc49e67d8" exitCode=0 Jul 22 01:38:14.190369 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.189974 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" event={"ID":"5a61535e-3454-4c25-9cbb-0ac5afe0fc80","Type":"ContainerDied","Data":"ed326ed610feb76bc1f274dd6e46fffd1d6efd1ac36924c58d49899bc49e67d8"} Jul 22 01:38:14.190369 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.190348 2561 scope.go:117] "RemoveContainer" containerID="ed326ed610feb76bc1f274dd6e46fffd1d6efd1ac36924c58d49899bc49e67d8" Jul 22 01:38:14.191397 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.191371 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:38:14.191454 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.191439 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:38:14.191490 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.191473 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:38:14.587299 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.587265 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:14.693734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:14.693706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:15.197835 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:15.197797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" event={"ID":"5a61535e-3454-4c25-9cbb-0ac5afe0fc80","Type":"ContainerStarted","Data":"824facf8291ca7e560d54f0e942e9af5dae5013f8b44887c405220386b599c27"} Jul 22 01:38:15.585158 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:15.585130 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:38:15.586336 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:15.586304 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 22 01:38:15.586453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:15.586357 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" podUID="5a61535e-3454-4c25-9cbb-0ac5afe0fc80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 22 01:38:16.584610 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:16.584569 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 22 01:38:16.585034 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:16.584627 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" podUID="5a61535e-3454-4c25-9cbb-0ac5afe0fc80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 22 01:38:17.565366 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:17.565333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:17.584687 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:17.584651 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 22 01:38:17.585074 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:17.584708 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" podUID="5a61535e-3454-4c25-9cbb-0ac5afe0fc80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 22 01:38:17.658304 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:17.658263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:17.714713 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:17.714675 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:38:18.584647 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:18.584612 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 22 01:38:18.584833 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:18.584668 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" podUID="5a61535e-3454-4c25-9cbb-0ac5afe0fc80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 22 01:38:19.618338 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:19.618304 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:38:19.619527 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:19.619508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7nzh" Jul 22 01:38:24.250558 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:24.250473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:26.819903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:26.819868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:27.457672 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:27.457640 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:38:28.817882 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:28.817853 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:37.141092 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:37.141040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:38.038975 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:38.038936 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:38:53.079874 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:53.079841 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:54.442577 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:54.442539 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:38:59.231565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.231530 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm"] Jul 22 01:38:59.232049 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.231947 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8e8111-a9df-4674-8281-837f47b584d7" containerName="authorino" Jul 22 01:38:59.232049 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.231961 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8e8111-a9df-4674-8281-837f47b584d7" containerName="authorino" Jul 22 01:38:59.232049 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.232031 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8e8111-a9df-4674-8281-837f47b584d7" containerName="authorino" Jul 22 01:38:59.235022 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.235005 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.238340 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.238313 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 01:38:59.238481 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.238345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sk8d9\"" Jul 22 01:38:59.238481 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.238320 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 01:38:59.238481 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.238318 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 01:38:59.246951 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.246926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:38:59.262972 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.262946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.263072 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.262976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.263072 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.262997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.263155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.263094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8edf329-a7e8-46b1-8005-88245d2e0df2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.263155 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.263148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.263234 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.263167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n557r\" (UniqueName: \"kubernetes.io/projected/e8edf329-a7e8-46b1-8005-88245d2e0df2-kube-api-access-n557r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.275153 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.275129 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm"] Jul 22 01:38:59.364469 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8edf329-a7e8-46b1-8005-88245d2e0df2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.364660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.364660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n557r\" (UniqueName: \"kubernetes.io/projected/e8edf329-a7e8-46b1-8005-88245d2e0df2-kube-api-access-n557r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.364660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.364660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.364660 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.365020 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.364999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.365090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.365036 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.365090 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.365076 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.366861 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.366839 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8edf329-a7e8-46b1-8005-88245d2e0df2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.366981 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.366964 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8edf329-a7e8-46b1-8005-88245d2e0df2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.389287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.389253 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n557r\" (UniqueName: \"kubernetes.io/projected/e8edf329-a7e8-46b1-8005-88245d2e0df2-kube-api-access-n557r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm\" (UID: \"e8edf329-a7e8-46b1-8005-88245d2e0df2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.545541 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.545441 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:38:59.689926 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.689896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm"] Jul 22 01:38:59.691404 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:38:59.691376 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8edf329_a7e8_46b1_8005_88245d2e0df2.slice/crio-2b080e3f174ba5c4834e85e4c4cafd56bfbd6d40597dcc0adef8f65285b038ef WatchSource:0}: Error finding container 2b080e3f174ba5c4834e85e4c4cafd56bfbd6d40597dcc0adef8f65285b038ef: Status 404 returned error can't find the container with id 2b080e3f174ba5c4834e85e4c4cafd56bfbd6d40597dcc0adef8f65285b038ef Jul 22 01:38:59.692684 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:38:59.692666 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:39:00.442630 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:00.442584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" event={"ID":"e8edf329-a7e8-46b1-8005-88245d2e0df2","Type":"ContainerStarted","Data":"2b080e3f174ba5c4834e85e4c4cafd56bfbd6d40597dcc0adef8f65285b038ef"} Jul 22 01:39:01.025858 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:01.025818 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:39:01.449536 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:01.449499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" event={"ID":"e8edf329-a7e8-46b1-8005-88245d2e0df2","Type":"ContainerStarted","Data":"2a147ddad2f0cef39e450f29a17f14de909d8035df9fecd5be0a92994bab4c1b"} Jul 22 01:39:01.480598 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:01.480547 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" podStartSLOduration=0.919127342 podStartE2EDuration="2.480531037s" totalImagesPullingTime="1.561403695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:39:01.479340526 +0000 UTC m=+659.534049148" watchObservedRunningTime="2026-07-22 01:39:01.480531037 +0000 UTC m=+659.535239710" Jul 22 01:39:05.445579 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:05.445546 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:39:08.064640 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:08.064605 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:39:09.545840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:09.545799 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:39:09.546239 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:09.545872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:39:09.558432 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:09.558398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:39:10.510160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:10.510133 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm" Jul 22 01:39:13.245977 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:13.245944 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:39:14.988878 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:14.988843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:39:50.417531 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.417490 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f85d45f7f-rwlbm"] Jul 22 01:39:50.423440 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.423421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.424752 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.424729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-tls-cert\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.424831 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.424814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vsv\" (UniqueName: \"kubernetes.io/projected/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-kube-api-access-w6vsv\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.428320 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.428125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cwvnk\"" Jul 22 01:39:50.428320 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.428144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 01:39:50.430619 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.430597 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f85d45f7f-rwlbm"] Jul 22 01:39:50.525723 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.525688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-tls-cert\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.525911 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.525744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vsv\" (UniqueName: \"kubernetes.io/projected/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-kube-api-access-w6vsv\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.528046 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.528024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-tls-cert\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.534257 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.534232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vsv\" (UniqueName: \"kubernetes.io/projected/f9bbe6ac-03d8-4a28-a087-1c2882a9920b-kube-api-access-w6vsv\") pod \"authorino-6f85d45f7f-rwlbm\" (UID: \"f9bbe6ac-03d8-4a28-a087-1c2882a9920b\") " pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.734688 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.734598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" Jul 22 01:39:50.811079 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.811041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:39:50.875468 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.875443 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f85d45f7f-rwlbm"] Jul 22 01:39:50.877364 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:39:50.877338 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9bbe6ac_03d8_4a28_a087_1c2882a9920b.slice/crio-d6927fdc6a3570cd31a79c57561f1d3127e1296540ffef6c81bb490dc936ae7c WatchSource:0}: Error finding container d6927fdc6a3570cd31a79c57561f1d3127e1296540ffef6c81bb490dc936ae7c: Status 404 returned error can't find the container with id d6927fdc6a3570cd31a79c57561f1d3127e1296540ffef6c81bb490dc936ae7c Jul 22 01:39:50.879237 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:50.879207 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:39:51.717744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:51.717637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" event={"ID":"f9bbe6ac-03d8-4a28-a087-1c2882a9920b","Type":"ContainerStarted","Data":"7ebaeab2dc9dc908aa9a9d0f619a37347eaf2c9ba77a3f5b0d7c148a5f1c4fab"} Jul 22 01:39:51.717744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:51.717693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" event={"ID":"f9bbe6ac-03d8-4a28-a087-1c2882a9920b","Type":"ContainerStarted","Data":"d6927fdc6a3570cd31a79c57561f1d3127e1296540ffef6c81bb490dc936ae7c"} Jul 22 01:39:51.739077 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:51.739011 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f85d45f7f-rwlbm" podStartSLOduration=1.203325432 podStartE2EDuration="1.738989527s" totalImagesPullingTime="535.664095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:39:51.736675484 +0000 UTC m=+709.791384111" watchObservedRunningTime="2026-07-22 01:39:51.738989527 +0000 UTC m=+709.793698155" Jul 22 01:39:51.944863 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:51.944834 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:39:52.039140 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:39:52.039047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:40:20.189985 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:40:20.189945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:40:29.789118 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:40:29.789080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:40:40.177193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:40:40.177154 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:41:55.386543 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:41:55.386496 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:41:57.161452 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:41:57.161423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:41:58.684089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:41:58.684056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:21.791377 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:21.791338 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:42:32.996339 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:32.996295 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:42:35.186858 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:35.186785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:35.282461 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:35.282429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:35.403390 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:35.403346 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:41.412106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:41.412072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:41.515734 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:41.515701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:41.612676 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:41.612642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:41.798355 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:41.798264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:48.169560 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:48.169499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:42:48.269781 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:42:48.269735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:43:03.120287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:03.120261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:43:03.120719 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:03.120695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:43:05.701695 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:05.701661 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:43:14.897023 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:14.896987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:43:17.216428 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:17.216399 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:43:18.648891 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:18.648856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:43:24.999500 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:24.999453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:43:30.787956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:30.787918 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:43:42.201068 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:42.201030 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:43:53.989420 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:43:53.989383 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:44:04.892089 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:44:04.892048 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:44:14.790131 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:44:14.790091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:44:37.087154 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:44:37.087060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:44:47.492565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:44:47.492530 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:45:11.698446 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:45:11.698406 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:45:24.294830 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:45:24.294795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:45:40.089993 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:45:40.089956 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:45:49.905394 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:45:49.905354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:45:59.693451 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:45:59.693359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:46:10.284611 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:10.284568 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:46:20.286076 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:20.286043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:46:20.471160 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:20.471111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:46:41.706546 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:41.706472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:46:44.980973 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:44.980932 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:46:44.981462 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:44.981123 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerName="manager" containerID="cri-o://db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d" gracePeriod=10 Jul 22 01:46:48.632469 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.632441 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:46:48.737294 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.737252 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw9cf\" (UniqueName: \"kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf\") pod \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " Jul 22 01:46:48.737496 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.737453 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume\") pod \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\" (UID: \"80ccc5c6-947c-41fe-b30f-469dae9c5fb9\") " Jul 22 01:46:48.737854 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.737824 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80ccc5c6-947c-41fe-b30f-469dae9c5fb9" (UID: "80ccc5c6-947c-41fe-b30f-469dae9c5fb9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:46:48.739376 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.739353 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf" (OuterVolumeSpecName: "kube-api-access-zw9cf") pod "80ccc5c6-947c-41fe-b30f-469dae9c5fb9" (UID: "80ccc5c6-947c-41fe-b30f-469dae9c5fb9"). InnerVolumeSpecName "kube-api-access-zw9cf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:46:48.838134 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.838093 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw9cf\" (UniqueName: \"kubernetes.io/projected/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-kube-api-access-zw9cf\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:46:48.838134 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:48.838126 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ccc5c6-947c-41fe-b30f-469dae9c5fb9-extensions-socket-volume\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:46:49.031422 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.031335 2561 generic.go:356] "Generic (PLEG): container finished" podID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerID="db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d" exitCode=0 Jul 22 01:46:49.031422 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.031381 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" Jul 22 01:46:49.031618 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.031425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" event={"ID":"80ccc5c6-947c-41fe-b30f-469dae9c5fb9","Type":"ContainerDied","Data":"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d"} Jul 22 01:46:49.031618 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.031476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" event={"ID":"80ccc5c6-947c-41fe-b30f-469dae9c5fb9","Type":"ContainerDied","Data":"2a6cdd10c0ee2cd16f6568913ad4308e4ec901d515b752d81e657d232c610848"} Jul 22 01:46:49.031618 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.031502 2561 scope.go:117] "RemoveContainer" containerID="db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d" Jul 22 01:46:49.041890 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.041872 2561 scope.go:117] "RemoveContainer" containerID="db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d" Jul 22 01:46:49.042149 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:46:49.042131 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d\": container with ID starting with db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d not found: ID does not exist" containerID="db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d" Jul 22 01:46:49.042198 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.042158 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d"} err="failed to get container status \"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d\": rpc error: code = NotFound desc = could not find container \"db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d\": container with ID starting with db5369d3b7ec87bd55df94798af4fcd7292930d19282a615573453a29302d33d not found: ID does not exist" Jul 22 01:46:49.055735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.055709 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:46:49.061840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.061818 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8"] Jul 22 01:46:49.552351 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:49.552302 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kmpp8" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.40:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 01:46:50.097337 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:46:50.097303 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" path="/var/lib/kubelet/pods/80ccc5c6-947c-41fe-b30f-469dae9c5fb9/volumes" Jul 22 01:47:46.490170 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.490134 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v"] Jul 22 01:47:46.490717 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.490655 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerName="manager" Jul 22 01:47:46.490717 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.490673 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerName="manager" Jul 22 01:47:46.490832 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.490785 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ccc5c6-947c-41fe-b30f-469dae9c5fb9" containerName="manager" Jul 22 01:47:46.493705 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.493688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.496906 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.496879 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f7tp2\"" Jul 22 01:47:46.507091 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.507069 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v"] Jul 22 01:47:46.643523 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.643489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a1c8ff-f847-40b3-acac-209542f4a1fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.643703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.643545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z85zt\" (UniqueName: \"kubernetes.io/projected/05a1c8ff-f847-40b3-acac-209542f4a1fb-kube-api-access-z85zt\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.744375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.744285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a1c8ff-f847-40b3-acac-209542f4a1fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.744375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.744341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z85zt\" (UniqueName: \"kubernetes.io/projected/05a1c8ff-f847-40b3-acac-209542f4a1fb-kube-api-access-z85zt\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.744742 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.744720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05a1c8ff-f847-40b3-acac-209542f4a1fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.758735 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.758710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z85zt\" (UniqueName: \"kubernetes.io/projected/05a1c8ff-f847-40b3-acac-209542f4a1fb-kube-api-access-z85zt\") pod \"kuadrant-operator-controller-manager-86878c769f-fz67v\" (UID: \"05a1c8ff-f847-40b3-acac-209542f4a1fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.804327 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.804292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:46.942709 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:46.942683 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v"] Jul 22 01:47:46.943942 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:47:46.943919 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a1c8ff_f847_40b3_acac_209542f4a1fb.slice/crio-287db50a7f3f854752a24340857445e9e64eca194e2a11b67e4c8e94b9d4683d WatchSource:0}: Error finding container 287db50a7f3f854752a24340857445e9e64eca194e2a11b67e4c8e94b9d4683d: Status 404 returned error can't find the container with id 287db50a7f3f854752a24340857445e9e64eca194e2a11b67e4c8e94b9d4683d Jul 22 01:47:47.342807 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:47.342772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" event={"ID":"05a1c8ff-f847-40b3-acac-209542f4a1fb","Type":"ContainerStarted","Data":"2cf1c5a520d3bb79947cabdcb724d67876ad7fba2be7d4e065a2a96b83d8d8e1"} Jul 22 01:47:47.343011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:47.342836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" event={"ID":"05a1c8ff-f847-40b3-acac-209542f4a1fb","Type":"ContainerStarted","Data":"287db50a7f3f854752a24340857445e9e64eca194e2a11b67e4c8e94b9d4683d"} Jul 22 01:47:47.343011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:47.342875 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:47:47.365190 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:47.365148 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" podStartSLOduration=1.365134173 podStartE2EDuration="1.365134173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:47.363951982 +0000 UTC m=+1185.418660645" watchObservedRunningTime="2026-07-22 01:47:47.365134173 +0000 UTC m=+1185.419842801" Jul 22 01:47:58.350656 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:47:58.350623 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fz67v" Jul 22 01:48:03.155386 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:03.155352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:48:03.157963 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:03.157945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:48:07.714909 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:07.714868 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:48:17.411418 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:17.411377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:48:29.990247 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:29.990209 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:48:43.842474 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:43.842439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:48:53.584029 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:48:53.583989 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:02.799903 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:02.799867 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:06.102383 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:06.102346 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:07.314837 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:07.314802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:13.303675 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:13.303633 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:23.580540 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:23.580491 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:35.088534 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:35.088487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:43.883935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:43.883895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:49:46.376659 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:46.376624 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:58.195453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:49:58.195420 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:50:16.689586 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:16.689547 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:50:25.993331 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:25.993241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:50:32.315270 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:32.315202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:37.290911 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:37.290867 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:50:41.842738 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:41.842702 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:53.883697 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:50:53.883657 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:51:01.304933 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:01.304897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:02.276175 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:02.276136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:05.698248 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:05.698209 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:51:20.293288 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:20.293253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:51:29.295620 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:29.295579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:51:42.491025 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:42.490990 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:51:56.888138 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:51:56.888050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:52:05.888095 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:05.888061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:52:18.876082 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:18.876035 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:20.385811 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:20.385756 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:52:29.891323 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:29.891287 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:52:43.602453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:43.602413 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:52:52.807718 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:52:52.807681 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:03.104286 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:03.104255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:03.191608 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:03.191576 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:53:03.193282 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:03.193262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:53:16.597103 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:16.597063 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:24.607640 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:24.607555 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:33.927553 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:33.927515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:44.991644 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:44.991606 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:53:57.588932 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:53:57.588896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:54:10.987591 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:10.987554 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:54:13.284282 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:13.284245 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:24.790994 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:24.790960 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:54:33.284673 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:33.284632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:54:34.946142 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:34.946098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:38.214646 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:38.214580 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:38.316381 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:38.316335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:38.736386 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:38.736349 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:44.857016 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:44.856979 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:44.918068 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:44.918031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:45.083374 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.083332 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:54:45.104621 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.104577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:45.419256 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.419222 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:54:45.422750 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.422729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.425365 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.425350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1afc4013-openshift-default-dockercfg-jx9w2\"" Jul 22 01:54:45.434596 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.434568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:45.445976 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.445950 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:54:45.528757 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.528757 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.528967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7bb\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.529009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.529056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.529265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.529133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.619172 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.619136 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:45.630286 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7bb\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630458 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630737 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630696 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.630986 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.630905 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.631628 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.631125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.631628 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.631454 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.631869 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.631742 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.633041 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.633019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.633149 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.633098 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.638345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.638320 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.638453 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.638387 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7bb\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb\") pod \"e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.734150 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.734051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:45.877023 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.876996 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:54:45.878554 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:54:45.878526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0202a1f5_d10d_46c5_a974_dea2f4eb698c.slice/crio-32f59cd6ebfcba766748a14fc054f25bdd392735325d5a2d24cdaab9639f590e WatchSource:0}: Error finding container 32f59cd6ebfcba766748a14fc054f25bdd392735325d5a2d24cdaab9639f590e: Status 404 returned error can't find the container with id 32f59cd6ebfcba766748a14fc054f25bdd392735325d5a2d24cdaab9639f590e Jul 22 01:54:45.880753 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.880718 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:54:45.880847 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.880818 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:54:45.880887 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:45.880865 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:54:46.653042 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:46.653001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerStarted","Data":"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4"} Jul 22 01:54:46.653239 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:46.653058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerStarted","Data":"32f59cd6ebfcba766748a14fc054f25bdd392735325d5a2d24cdaab9639f590e"} Jul 22 01:54:46.682300 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:46.682242 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" podStartSLOduration=1.6822282400000002 podStartE2EDuration="1.68222824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:54:46.68127204 +0000 UTC m=+1604.735980667" watchObservedRunningTime="2026-07-22 01:54:46.68222824 +0000 UTC m=+1604.736936868" Jul 22 01:54:46.734757 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:46.734723 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:46.739744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:46.739717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:47.658902 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:47.658865 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:47.659840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:47.659822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:54:48.031427 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.031315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:48.116910 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.116879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:48.183486 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.183444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:48.321524 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.321433 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:48.799171 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.799135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:48.901345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:48.901311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:53.587137 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:54:53.587097 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:55:01.738011 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.737979 2561 generic.go:356] "Generic (PLEG): container finished" podID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerID="d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4" exitCode=0 Jul 22 01:55:01.738426 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.738023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerDied","Data":"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4"} Jul 22 01:55:01.738504 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.738488 2561 scope.go:117] "RemoveContainer" containerID="d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4" Jul 22 01:55:01.739598 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.739565 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:55:01.739672 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.739656 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:55:01.739721 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:01.739702 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:55:02.659442 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:02.659398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:02.750511 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:02.750463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerStarted","Data":"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f"} Jul 22 01:55:03.735711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:03.735558 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:03.736425 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:03.736061 2561 patch_prober.go:28] interesting pod/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 22 01:55:03.736425 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:03.736123 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 22 01:55:04.734953 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:04.734906 2561 patch_prober.go:28] interesting pod/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 22 01:55:04.735594 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:04.734981 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 22 01:55:05.735923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:05.735424 2561 patch_prober.go:28] interesting pod/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 22 01:55:05.735923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:05.735500 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 22 01:55:06.738982 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:06.738949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:06.739367 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:06.739232 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:06.739925 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:06.739907 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:24.383566 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:24.383522 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:27.092818 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:27.092779 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:55:28.851716 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:28.851680 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:29.000106 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.000076 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:55:29.000389 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.000362 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" containerID="cri-o://59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f" gracePeriod=30 Jul 22 01:55:29.019376 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.019341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:29.282017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.281914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:29.550972 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.550868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:29.648394 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.648357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:29.764271 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:29.764231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:30.104273 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:30.104240 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:30.372272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:30.372183 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:34.249012 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.248983 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:34.293233 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293158 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf7bb\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293233 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293222 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293249 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293298 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293313 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293342 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293449 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293374 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293450 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293476 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token\") pod \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\" (UID: \"0202a1f5-d10d-46c5-a974-dea2f4eb698c\") " Jul 22 01:55:34.293708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293616 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:55:34.293881 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293701 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:55:34.293881 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293840 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istiod-ca-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.293881 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293863 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.294334 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293949 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:55:34.294334 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.293978 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:55:34.294604 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.294581 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data" (OuterVolumeSpecName: "istio-data") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:55:34.295666 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.295639 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb" (OuterVolumeSpecName: "kube-api-access-wf7bb") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "kube-api-access-wf7bb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:55:34.295808 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.295742 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:55:34.296017 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.295999 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 01:55:34.296077 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.296063 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token" (OuterVolumeSpecName: "istio-token") pod "0202a1f5-d10d-46c5-a974-dea2f4eb698c" (UID: "0202a1f5-d10d-46c5-a974-dea2f4eb698c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:55:34.394668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394624 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-workload-certs\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394659 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-podinfo\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394668 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394670 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-credential-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394679 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-envoy\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394689 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-token\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394696 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf7bb\" (UniqueName: \"kubernetes.io/projected/0202a1f5-d10d-46c5-a974-dea2f4eb698c-kube-api-access-wf7bb\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.394937 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.394704 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0202a1f5-d10d-46c5-a974-dea2f4eb698c-istio-data\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:55:34.943364 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.943330 2561 generic.go:356] "Generic (PLEG): container finished" podID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerID="59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f" exitCode=0 Jul 22 01:55:34.943565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.943380 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" Jul 22 01:55:34.943565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.943420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerDied","Data":"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f"} Jul 22 01:55:34.943565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.943489 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4" event={"ID":"0202a1f5-d10d-46c5-a974-dea2f4eb698c","Type":"ContainerDied","Data":"32f59cd6ebfcba766748a14fc054f25bdd392735325d5a2d24cdaab9639f590e"} Jul 22 01:55:34.943565 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.943519 2561 scope.go:117] "RemoveContainer" containerID="59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f" Jul 22 01:55:34.953334 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.953317 2561 scope.go:117] "RemoveContainer" containerID="d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4" Jul 22 01:55:34.961733 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.961714 2561 scope.go:117] "RemoveContainer" containerID="59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f" Jul 22 01:55:34.962026 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:55:34.961985 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f\": container with ID starting with 59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f not found: ID does not exist" containerID="59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f" Jul 22 01:55:34.962131 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.962034 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f"} err="failed to get container status \"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f\": rpc error: code = NotFound desc = could not find container \"59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f\": container with ID starting with 59f139381f652ee41867cf78cc7b07729f990b603469a270467d1b5e51d4e73f not found: ID does not exist" Jul 22 01:55:34.962131 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.962052 2561 scope.go:117] "RemoveContainer" containerID="d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4" Jul 22 01:55:34.962348 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:55:34.962319 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4\": container with ID starting with d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4 not found: ID does not exist" containerID="d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4" Jul 22 01:55:34.962546 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.962356 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4"} err="failed to get container status \"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4\": rpc error: code = NotFound desc = could not find container \"d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4\": container with ID starting with d7f0ee73c3711041f1433f5e71655611becd546fd914022c118bf80f271419f4 not found: ID does not exist" Jul 22 01:55:34.965475 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.965452 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:55:34.971383 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:34.971362 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1afc4013-openshift-default-786cff5657-z8fb4"] Jul 22 01:55:35.709564 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:35.709521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:35.911744 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:35.911710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:36.098032 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:36.097994 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" path="/var/lib/kubelet/pods/0202a1f5-d10d-46c5-a974-dea2f4eb698c/volumes" Jul 22 01:55:36.358506 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:36.358409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:36.457345 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:36.457309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:36.559125 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:36.559087 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:39.392850 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:55:39.392813 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:56:11.350359 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:11.350319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:14.487151 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:14.487110 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:56:15.909018 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:15.908983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.067288 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.067258 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.346625 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.346597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.573288 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.573243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.889287 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889258 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:56:16.889646 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889633 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.889702 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889648 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.889702 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889668 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.889702 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889674 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.889840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889734 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.889840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.889741 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0202a1f5-d10d-46c5-a974-dea2f4eb698c" containerName="istio-proxy" Jul 22 01:56:16.893527 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.893505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.896139 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.896113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3247df58-openshift-default-dockercfg-ztjdx\"" Jul 22 01:56:16.904405 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.904381 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:56:16.913489 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.913464 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.985223 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985496 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985622 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985712 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985712 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985848 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985848 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985958 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjcsg\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:16.985958 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:16.985915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086511 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086694 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjcsg\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.086935 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087031 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086955 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087031 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087031 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.087018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087175 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.087039 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087175 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.086986 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087319 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.087216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.087319 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.087291 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.088971 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.088943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.089290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.089274 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.095594 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.095569 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.096019 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.095997 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjcsg\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg\") pod \"e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.204534 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.204409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:17.249756 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.249697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:17.353381 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.353337 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:56:17.360595 ip-10-0-136-148 kubenswrapper[2561]: W0722 01:56:17.360561 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea613971_8e0b_42ed_bc3d_0ce95cfd79e0.slice/crio-eb03500fd32f1a6e6d00265fff9c1375e864235e6c35d08a29b525dc6445b1d4 WatchSource:0}: Error finding container eb03500fd32f1a6e6d00265fff9c1375e864235e6c35d08a29b525dc6445b1d4: Status 404 returned error can't find the container with id eb03500fd32f1a6e6d00265fff9c1375e864235e6c35d08a29b525dc6445b1d4 Jul 22 01:56:17.362753 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.362718 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:17.362865 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.362808 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:17.362865 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:17.362837 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:18.173133 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:18.173098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerStarted","Data":"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050"} Jul 22 01:56:18.173621 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:18.173154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerStarted","Data":"eb03500fd32f1a6e6d00265fff9c1375e864235e6c35d08a29b525dc6445b1d4"} Jul 22 01:56:18.195956 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:18.195905 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podStartSLOduration=2.195891413 podStartE2EDuration="2.195891413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:56:18.193088947 +0000 UTC m=+1696.247797573" watchObservedRunningTime="2026-07-22 01:56:18.195891413 +0000 UTC m=+1696.250600039" Jul 22 01:56:18.205127 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:18.205098 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:18.209831 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:18.209807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:19.179372 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.179340 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:19.180387 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.180367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:19.544457 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.544369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:19.634890 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.634855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:19.702540 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.702501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:19.912650 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:19.912615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:20.115358 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:20.115326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:20.215602 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:20.215519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:25.592137 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:25.592050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:56:34.180896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.180854 2561 patch_prober.go:28] interesting pod/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 22 01:56:34.181391 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.180930 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 22 01:56:34.269272 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.269240 2561 generic.go:356] "Generic (PLEG): container finished" podID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerID="1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050" exitCode=0 Jul 22 01:56:34.269484 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.269320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerDied","Data":"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050"} Jul 22 01:56:34.269798 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.269757 2561 scope.go:117] "RemoveContainer" containerID="1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050" Jul 22 01:56:34.270832 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.270799 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:34.270924 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.270872 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:34.270924 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:34.270910 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 01:56:35.279375 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:35.279338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerStarted","Data":"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90"} Jul 22 01:56:36.205603 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:36.205565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:36.205844 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:36.205821 2561 patch_prober.go:28] interesting pod/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 22 01:56:36.205894 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:36.205872 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 22 01:56:37.205854 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:37.205818 2561 patch_prober.go:28] interesting pod/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 22 01:56:37.206265 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:37.205889 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 22 01:56:38.205850 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:38.205810 2561 patch_prober.go:28] interesting pod/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 22 01:56:38.206034 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:38.205878 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 22 01:56:39.205097 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:39.205054 2561 patch_prober.go:28] interesting pod/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 22 01:56:39.205280 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:39.205116 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 22 01:56:40.209198 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:40.209167 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:40.209680 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:40.209533 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:40.210168 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:40.210149 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:56:49.518024 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:49.517985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:56.069980 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:56.069947 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:58.896083 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:56:58.896047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:57:00.668954 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:00.668911 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:01.991109 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:01.991056 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:57:01.991703 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:01.991373 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" containerID="cri-o://8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90" gracePeriod=30 Jul 22 01:57:02.014750 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:02.014715 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:02.251154 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:02.251063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:02.517421 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:02.517322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:02.859494 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:02.859452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:03.152341 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:03.152254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.113235 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.113166 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.216145 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.216108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.339986 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.339950 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.601750 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.601718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.803757 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.803725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:05.911290 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:05.911198 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:07.239581 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.239555 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:57:07.358356 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358322 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358356 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358359 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjcsg\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358561 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358392 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358561 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358466 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358610 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358680 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358708 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358696 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:57:07.358912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358729 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358776 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358757 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:57:07.358912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358802 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy\") pod \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\" (UID: \"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0\") " Jul 22 01:57:07.358912 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358867 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:57:07.359179 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.358988 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:57:07.359179 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.359130 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istiod-ca-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.359179 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.359153 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.359179 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.359167 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-workload-certs\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.359384 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.359183 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-credential-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.359696 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.359667 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:57:07.360630 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.360607 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg" (OuterVolumeSpecName: "kube-api-access-gjcsg") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "kube-api-access-gjcsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:57:07.360795 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.360755 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 01:57:07.360871 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.360798 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:57:07.360923 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.360907 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" (UID: "ea613971-8e0b-42ed-bc3d-0ce95cfd79e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:57:07.453628 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.453595 2561 generic.go:356] "Generic (PLEG): container finished" podID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerID="8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90" exitCode=0 Jul 22 01:57:07.453826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.453634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerDied","Data":"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90"} Jul 22 01:57:07.453826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.453653 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" Jul 22 01:57:07.453826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.453700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv" event={"ID":"ea613971-8e0b-42ed-bc3d-0ce95cfd79e0","Type":"ContainerDied","Data":"eb03500fd32f1a6e6d00265fff9c1375e864235e6c35d08a29b525dc6445b1d4"} Jul 22 01:57:07.453826 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.453722 2561 scope.go:117] "RemoveContainer" containerID="8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90" Jul 22 01:57:07.459583 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.459562 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-podinfo\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.459583 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.459584 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-data\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.459723 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.459597 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-envoy\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.459723 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.459609 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjcsg\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-kube-api-access-gjcsg\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.459723 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.459622 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0-istio-token\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 01:57:07.465472 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.465453 2561 scope.go:117] "RemoveContainer" containerID="1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050" Jul 22 01:57:07.474242 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.474218 2561 scope.go:117] "RemoveContainer" containerID="8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90" Jul 22 01:57:07.474523 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:57:07.474504 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90\": container with ID starting with 8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90 not found: ID does not exist" containerID="8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90" Jul 22 01:57:07.474573 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.474532 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90"} err="failed to get container status \"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90\": rpc error: code = NotFound desc = could not find container \"8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90\": container with ID starting with 8b6e225bc13f2a735cb8b845611cba74f7988cd510ac568708092abadfd23b90 not found: ID does not exist" Jul 22 01:57:07.474573 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.474550 2561 scope.go:117] "RemoveContainer" containerID="1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050" Jul 22 01:57:07.474799 ip-10-0-136-148 kubenswrapper[2561]: E0722 01:57:07.474754 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050\": container with ID starting with 1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050 not found: ID does not exist" containerID="1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050" Jul 22 01:57:07.474868 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.474810 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050"} err="failed to get container status \"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050\": rpc error: code = NotFound desc = could not find container \"1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050\": container with ID starting with 1a86dcee2218937b76a21c34c5feeb1839fd6f0ae0df094de8ef9e18c15a8050 not found: ID does not exist" Jul 22 01:57:07.475959 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.475942 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:57:07.484062 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:07.484041 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3247df58-openshift-default-c5c868c77-7j2vv"] Jul 22 01:57:08.097215 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:08.097179 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" path="/var/lib/kubelet/pods/ea613971-8e0b-42ed-bc3d-0ce95cfd79e0/volumes" Jul 22 01:57:08.097469 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:08.097454 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:57:22.367840 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:22.367809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:22.464899 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:22.464863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:26.601421 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:26.601378 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:26.696205 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:26.696167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:40.664625 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:40.664586 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:43.785679 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:43.785642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:57:45.172299 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:45.172260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:45.382558 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:45.382516 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:45.609513 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:45.609476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:46.081941 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:46.081900 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:46.180695 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:46.180659 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:46.281754 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:46.281717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:47.750711 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:47.750682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:53.755211 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:53.755172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:53.811201 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:53.811169 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:53.895882 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:53.895786 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:53.992551 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:53.992518 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:54.089547 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:54.089504 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:54.534353 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:57:54.534261 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:03.231480 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:03.231452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:58:03.232520 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:03.232495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 01:58:20.545010 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:20.544969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:26.962129 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:26.962082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:27.063745 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:27.063691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:27.164132 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:27.164089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:43.113869 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:43.113831 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:49.151971 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:49.151932 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:49.208771 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:49.208728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:49.295929 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:49.295897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:49.390100 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:49.390063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:54.370054 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:54.370013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:59.942733 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:58:59.942700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:00.788873 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:00.788821 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:08.123117 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:08.123077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:08.232532 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:08.232492 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:08.323114 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:08.323069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:08.422820 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:08.422708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:09.244681 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:09.244636 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:09.343832 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:09.343791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:09.411193 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:09.411153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:11.163412 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:11.163381 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:12.085402 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:12.085368 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:59:17.163417 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:17.163383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:18.551885 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:18.551847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:22.996101 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:22.996051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:59:23.907972 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:23.907882 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:24.023534 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:24.023500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:24.200512 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:24.200418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:24.502800 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:24.502687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:24.623634 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:24.623600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:27.421999 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:27.421958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:27.512913 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:27.512880 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:27.570406 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:27.570365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:27.995955 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:27.995915 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:28.096896 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:28.096859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:28.198061 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:28.198025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:31.954278 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:31.954245 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:32.651224 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:32.651188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:32.755206 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:32.755163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:33.113223 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:33.113183 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:33.585973 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:33.585928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:59:39.209162 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:39.209127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:39.270398 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:39.270369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:50.186038 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:50.186002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:52.989052 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:52.989014 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 01:59:54.661305 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:54.661264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:55.101229 ip-10-0-136-148 kubenswrapper[2561]: I0722 01:59:55.101197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:01.275138 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:01.275100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:01.613781 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:01.613737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:01.758475 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:01.758414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:01.859327 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:01.859291 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:01.976220 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:01.976130 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:02.075310 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:02.075273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:02.229339 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:02.229251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:08.334040 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:08.333991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:08.415427 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:08.415380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:08.859015 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:08.858981 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:08.916020 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:08.915985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:14.580812 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:14.580739 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:14.681183 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:14.681153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:21.664690 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:21.664655 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:22.020696 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:22.020619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:22.483389 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:22.483360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:24.677451 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:24.677409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:24.777086 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:24.777045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:24.921566 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:24.921534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:25.022821 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:25.022706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:25.443758 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:25.443715 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:25.543621 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:25.543585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:29.248592 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:29.248561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:29.889923 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:29.889891 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:00:37.057138 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:37.057102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:37.111361 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:37.111329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:53.546335 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:53.546301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:00:56.956238 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:00:56.956147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:00.385990 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:00.385949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:01:14.887974 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:14.887933 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:01:32.097494 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:32.097458 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:01:33.868605 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:33.868568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:38.490289 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:38.490251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:40.854327 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:40.854291 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:42.152132 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:42.152100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:01:45.933640 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:01:45.933587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:22.643166 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:22.643127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:23.211241 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:23.211208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:23.309649 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:23.309604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:23.412135 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:23.412089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:29.029087 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:29.028998 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:29.095609 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:29.095578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:29.387514 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:29.387477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:29.632025 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:29.631989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:30.738748 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:30.738713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:30.839254 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:30.839217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:30.940520 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:30.940466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:31.785319 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:31.785264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:31.886022 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:31.885970 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:31.985897 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:31.985859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:33.293164 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:33.293133 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:02:33.597801 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:33.597739 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:39.830332 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:39.830293 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:39.886983 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:39.886952 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:40.760870 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:40.760828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:43.183011 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:43.182976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:02:47.165043 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:47.164984 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:47.264416 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:47.264383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:47.364003 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:47.363964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:47.468225 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:47.468131 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:58.045429 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:58.045396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:58.460357 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:02:58.460319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:03.269948 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:03.269910 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:03:03.271975 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:03.271954 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:03:19.563246 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:19.563206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:25.939298 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:25.939259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:26.040362 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:26.040319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:26.333420 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:26.333392 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:26.660743 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:26.660660 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:26.822178 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:26.822141 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:29.640961 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:29.640917 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:29.737781 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:29.737732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:29.797059 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:29.797025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:29.906112 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:29.906023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:30.277369 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:30.277288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:30.378426 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:30.378390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:34.117785 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:34.117725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:34.469954 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:34.469904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:34.846502 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:34.846463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:35.030316 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:35.030278 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:35.399464 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:35.399431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:03:37.612743 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:37.612699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:37.685001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:37.684961 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:37.750548 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:37.750499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:37.958862 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:37.958725 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:38.280676 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:38.280581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:38.381179 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:38.381127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:42.204309 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:42.204273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:47.096050 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:47.096013 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:03:50.472044 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:50.472012 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:51.000372 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:51.000338 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:51.101123 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:51.101080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:56.054497 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:56.054397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:58.485001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:58.484970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:03:59.044350 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:59.044314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:59.143784 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:03:59.143703 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:04:08.483182 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:04:08.483143 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:04:17.252337 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:04:17.252304 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:04:20.497156 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:04:20.497113 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:04:36.990754 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:04:36.990721 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:05:12.859372 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:12.859333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:13.974510 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974476 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn"] Jul 22 02:05:13.974909 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974869 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:05:13.974909 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974881 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:05:13.974909 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974889 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:05:13.974909 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974894 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:05:13.975038 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.974968 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:05:13.977898 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.977872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:13.980275 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.980252 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:05:13.980397 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.980275 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-twths\"" Jul 22 02:05:13.984522 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:13.984497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn"] Jul 22 02:05:14.081535 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.081509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn\" (UID: \"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:14.183028 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.182992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn\" (UID: \"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:14.183648 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.183624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn\" (UID: \"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:14.290362 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.290264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:14.358380 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.358344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:14.420509 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.420479 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn"] Jul 22 02:05:14.422345 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:05:14.422314 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe88d5cc_2edb_4ce3_a39c_8874a8ebea4f.slice/crio-befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac WatchSource:0}: Error finding container befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac: Status 404 returned error can't find the container with id befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac Jul 22 02:05:14.424206 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.424189 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:05:14.627610 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.627575 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:14.728444 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:14.728413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:15.090589 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:15.090553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" event={"ID":"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f","Type":"ContainerStarted","Data":"befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac"} Jul 22 02:05:17.987880 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:17.987849 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:05:19.116455 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:19.116423 2561 generic.go:356] "Generic (PLEG): container finished" podID="be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" containerID="1ad77c22b252c3073281f949b5efe4b41cbb472e5df1504e81c105f22c81709c" exitCode=0 Jul 22 02:05:19.116885 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:19.116520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" event={"ID":"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f","Type":"ContainerDied","Data":"1ad77c22b252c3073281f949b5efe4b41cbb472e5df1504e81c105f22c81709c"} Jul 22 02:05:20.251743 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:20.251720 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:20.335543 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:20.335508 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca\") pod \"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f\" (UID: \"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f\") " Jul 22 02:05:20.335885 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:20.335860 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" (UID: "be88d5cc-2edb-4ce3-a39c-8874a8ebea4f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:05:20.436635 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:20.436552 2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f-maas-api-service-ca\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:05:20.862637 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:20.862588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:21.128621 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:21.128543 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" Jul 22 02:05:21.128621 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:21.128577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn" event={"ID":"be88d5cc-2edb-4ce3-a39c-8874a8ebea4f","Type":"ContainerDied","Data":"befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac"} Jul 22 02:05:21.128621 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:21.128616 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="befe11c6c7266309a0e468df7b8f5cdc9ae9d11d5ab380e2ab3e7bfd01f5dbac" Jul 22 02:05:24.424444 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:24.424363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:29.050309 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:29.050273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:29.062425 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:29.062358 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn"] Jul 22 02:05:29.064821 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:29.064799 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cf99ea-m7wnn"] Jul 22 02:05:29.537183 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:29.537151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:30.096896 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:30.096863 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" path="/var/lib/kubelet/pods/be88d5cc-2edb-4ce3-a39c-8874a8ebea4f/volumes" Jul 22 02:05:33.793962 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:33.793928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:05:35.486000 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:35.485960 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:35.540737 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:35.540697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:35.764133 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:35.764036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:36.003746 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:36.003710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:36.872467 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:36.872424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:36.972554 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:36.972513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:46.808751 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:46.808711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:49.591419 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:49.591381 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:05:51.198926 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:51.198891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:51.992590 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:51.992545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:57.671780 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:57.671737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:57.767503 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:57.767469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:57.962089 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:57.961989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:58.204938 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:58.204904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:58.591191 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:58.591155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:58.924406 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:58.924320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:59.157139 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:05:59.157106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:02.299811 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:02.299723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:02.413470 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:02.413435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:02.506133 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:02.506094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:02.651705 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:02.651673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:03.072859 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:03.072749 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:03.173158 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:03.173113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:06.895065 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:06.895026 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:07.409724 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.409683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:07.717252 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.717169 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:06:07.717604 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.717592 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" containerName="revoke-keys" Jul 22 02:06:07.717645 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.717606 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" containerName="revoke-keys" Jul 22 02:06:07.717680 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.717675 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea613971-8e0b-42ed-bc3d-0ce95cfd79e0" containerName="istio-proxy" Jul 22 02:06:07.717714 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.717687 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be88d5cc-2edb-4ce3-a39c-8874a8ebea4f" containerName="revoke-keys" Jul 22 02:06:07.720543 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.720526 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.723080 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.723058 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4f2856-openshift-default-dockercfg-txwg4\"" Jul 22 02:06:07.733309 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.733283 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:06:07.743280 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.743233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:07.793744 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.793715 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:06:07.866553 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.866756 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.866756 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.866756 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.866756 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.867001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.867001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxd2\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.867001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.867001 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.866899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.904934 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.904905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:07.968329 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968329 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxd2\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968948 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.968948 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968932 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.969073 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.968965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.969073 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.969007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.969165 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.969145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.970887 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.970863 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.971076 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.971057 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.976870 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.976846 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:07.977050 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:07.977032 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxd2\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2\") pod \"e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:08.031635 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.031602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:08.166297 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.166275 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:06:08.168131 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:06:08.168103 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db8bb62_1db0_4e67_9f36_b0887241f662.slice/crio-81cf5f4a001eb8dc100c939751b1f9eb0683c4c749c9f56774ec697449e4ed43 WatchSource:0}: Error finding container 81cf5f4a001eb8dc100c939751b1f9eb0683c4c749c9f56774ec697449e4ed43: Status 404 returned error can't find the container with id 81cf5f4a001eb8dc100c939751b1f9eb0683c4c749c9f56774ec697449e4ed43 Jul 22 02:06:08.170392 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.170351 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:08.170468 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.170444 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:08.170504 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.170486 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:08.380259 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.380221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerStarted","Data":"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d"} Jul 22 02:06:08.380463 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.380278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerStarted","Data":"81cf5f4a001eb8dc100c939751b1f9eb0683c4c749c9f56774ec697449e4ed43"} Jul 22 02:06:08.400996 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:08.400943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podStartSLOduration=1.4009247249999999 podStartE2EDuration="1.400924725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:06:08.398206548 +0000 UTC m=+2286.452915174" watchObservedRunningTime="2026-07-22 02:06:08.400924725 +0000 UTC m=+2286.455633355" Jul 22 02:06:09.032786 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:09.032724 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:09.038231 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:09.038205 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:09.385905 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:09.385875 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:09.386723 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:09.386705 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:10.388032 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:10.387995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:10.500738 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:10.500635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:10.581324 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:10.581291 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:10.647851 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:10.647748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:11.065540 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:11.065411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:11.165706 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:11.165672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:14.987307 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:14.987262 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:18.084521 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:18.084484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:06:23.893358 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:23.893322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:23.991063 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:23.991024 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:25.426946 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:25.426905 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 02:06:25.427324 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:25.426983 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 02:06:27.502306 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.502272 2561 generic.go:356] "Generic (PLEG): container finished" podID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerID="c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d" exitCode=0 Jul 22 02:06:27.502757 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.502346 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerDied","Data":"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d"} Jul 22 02:06:27.502757 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.502727 2561 scope.go:117] "RemoveContainer" containerID="c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d" Jul 22 02:06:27.503757 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.503730 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:27.503872 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.503853 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:27.503928 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:27.503912 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:06:28.509951 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:28.509916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerStarted","Data":"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4"} Jul 22 02:06:29.032141 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:29.032106 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:29.032530 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:29.032445 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 22 02:06:29.032744 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:29.032720 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 22 02:06:30.032200 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:30.032156 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 22 02:06:30.032877 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:30.032843 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 22 02:06:31.032176 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:31.032138 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 22 02:06:31.032387 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:31.032208 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 22 02:06:32.032471 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:32.032430 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 22 02:06:32.033100 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:32.033067 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 22 02:06:32.620851 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:32.620822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:32.718671 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:32.718635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:33.036190 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:33.036099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:33.036647 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:33.036390 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:33.037231 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:33.037209 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:06:34.172343 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:34.172305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:34.273630 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:34.273595 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:39.430218 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:39.430181 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:42.082042 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:42.082003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:06:43.628242 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:43.628208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:44.082492 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:44.082452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:50.127819 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:50.127748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:50.228783 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:50.228741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:50.425693 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:50.425587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:50.674487 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:50.674449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:51.380195 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:51.380160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:06:51.480392 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:06:51.480343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:06.275142 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:06.275056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:10.884887 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:10.884845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:10.987108 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:10.987076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:07:11.287952 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:11.287856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:17.159094 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.159063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:17.214496 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.214462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:17.464890 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.464810 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:07:17.465146 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.465121 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" containerID="cri-o://f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4" gracePeriod=30 Jul 22 02:07:17.482903 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.482873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:17.753402 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:17.753312 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:18.038857 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:18.038753 2561 patch_prober.go:28] interesting pod/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 02:07:18.039005 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:18.038876 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:07:18.148459 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:18.148411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:18.470383 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:18.470337 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:18.702799 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:18.702753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:21.702192 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:21.702151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:21.803649 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:21.803600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:21.947826 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:21.947789 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:22.254259 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.254218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:22.558466 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.558369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:22.658708 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.658676 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:22.727699 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.727672 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:07:22.813807 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.813711 2561 generic.go:356] "Generic (PLEG): container finished" podID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerID="f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4" exitCode=0 Jul 22 02:07:22.813807 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.813756 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" Jul 22 02:07:22.813807 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.813795 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerDied","Data":"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4"} Jul 22 02:07:22.814031 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.813841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4" event={"ID":"5db8bb62-1db0-4e67-9f36-b0887241f662","Type":"ContainerDied","Data":"81cf5f4a001eb8dc100c939751b1f9eb0683c4c749c9f56774ec697449e4ed43"} Jul 22 02:07:22.814031 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.813866 2561 scope.go:117] "RemoveContainer" containerID="f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4" Jul 22 02:07:22.823606 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.823579 2561 scope.go:117] "RemoveContainer" containerID="c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d" Jul 22 02:07:22.831869 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.831846 2561 scope.go:117] "RemoveContainer" containerID="f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4" Jul 22 02:07:22.832124 ip-10-0-136-148 kubenswrapper[2561]: E0722 02:07:22.832104 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4\": container with ID starting with f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4 not found: ID does not exist" containerID="f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4" Jul 22 02:07:22.832172 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.832134 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4"} err="failed to get container status \"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4\": rpc error: code = NotFound desc = could not find container \"f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4\": container with ID starting with f8966ef4bfbc1af1e31f6d0b8928339d2f5409afd89255330f82e1e216d025d4 not found: ID does not exist" Jul 22 02:07:22.832172 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.832152 2561 scope.go:117] "RemoveContainer" containerID="c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d" Jul 22 02:07:22.832388 ip-10-0-136-148 kubenswrapper[2561]: E0722 02:07:22.832369 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d\": container with ID starting with c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d not found: ID does not exist" containerID="c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d" Jul 22 02:07:22.832445 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.832406 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d"} err="failed to get container status \"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d\": rpc error: code = NotFound desc = could not find container \"c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d\": container with ID starting with c8f960c1fc91844c0fe88075349a317502ceba5be18953e209365fef6a6f1f1d not found: ID does not exist" Jul 22 02:07:22.876755 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876723 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.876755 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876756 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.876980 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876828 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.876980 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876879 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.876980 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876914 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.876980 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.876939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.877196 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877037 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:07:22.877196 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877062 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.877196 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877106 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:07:22.877196 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877167 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.877420 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877217 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mxd2\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2\") pod \"5db8bb62-1db0-4e67-9f36-b0887241f662\" (UID: \"5db8bb62-1db0-4e67-9f36-b0887241f662\") " Jul 22 02:07:22.877420 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877295 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:07:22.877517 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877453 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:07:22.877682 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877607 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db8bb62-1db0-4e67-9f36-b0887241f662-istiod-ca-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.877682 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877632 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.877682 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877646 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-credential-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.877682 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877660 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-workload-certs\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.877978 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.877954 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data" (OuterVolumeSpecName: "istio-data") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:07:22.879258 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.879235 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token" (OuterVolumeSpecName: "istio-token") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:07:22.879339 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.879280 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:07:22.879548 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.879527 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2" (OuterVolumeSpecName: "kube-api-access-4mxd2") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "kube-api-access-4mxd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:07:22.879608 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.879537 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5db8bb62-1db0-4e67-9f36-b0887241f662" (UID: "5db8bb62-1db0-4e67-9f36-b0887241f662"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:07:22.978553 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.978521 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-token\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.978553 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.978549 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-podinfo\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.978553 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.978558 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-envoy\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.978809 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.978567 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db8bb62-1db0-4e67-9f36-b0887241f662-istio-data\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:22.978809 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:22.978575 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxd2\" (UniqueName: \"kubernetes.io/projected/5db8bb62-1db0-4e67-9f36-b0887241f662-kube-api-access-4mxd2\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:07:23.135984 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:23.135947 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:07:23.140790 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:23.140745 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4f2856-openshift-default-6679b85cf9-4qjn4"] Jul 22 02:07:24.097218 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:24.097179 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" path="/var/lib/kubelet/pods/5db8bb62-1db0-4e67-9f36-b0887241f662/volumes" Jul 22 02:07:24.161362 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:24.161317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:24.264525 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:24.264489 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:26.295940 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.295895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:26.662655 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.662614 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:26.985960 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.985880 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:07:26.986461 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.986444 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:07:26.986503 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.986465 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:07:26.986503 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.986480 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:07:26.986503 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.986489 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:07:26.986623 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.986611 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:07:26.991819 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.991798 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:26.994069 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.994049 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1f4af7-openshift-default-dockercfg-jxfkj\"" Jul 22 02:07:26.999835 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:26.999807 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:07:27.016335 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.016309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:27.115387 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115560 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115560 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115560 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115560 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115702 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115702 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115702 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.115702 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.115644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47s88\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.150190 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.150157 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:27.216645 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216645 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47s88\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.216932 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.216925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.217296 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.217120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.217296 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.217200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.217296 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.217270 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.217462 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.217430 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.217550 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.217531 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.219390 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.219368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.219502 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.219477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.228890 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.228862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.229491 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.229463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47s88\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88\") pod \"e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.304796 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.304702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:27.445025 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.444999 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:07:27.446833 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:07:27.446801 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeead7531_181d_40e0_9ccd_4d96deb7d8da.slice/crio-1f3bd66cef3f53504ab743f0afb218693434527bc3f7c41e9526a5f470d9907c WatchSource:0}: Error finding container 1f3bd66cef3f53504ab743f0afb218693434527bc3f7c41e9526a5f470d9907c: Status 404 returned error can't find the container with id 1f3bd66cef3f53504ab743f0afb218693434527bc3f7c41e9526a5f470d9907c Jul 22 02:07:27.448879 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.448841 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:27.448965 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.448925 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:27.449011 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.448963 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:27.850577 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.850540 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerStarted","Data":"19144f8cdedf4cd9c71b94b5ca49809ed9fc9ec93fbb434fa4b358f296200b3e"} Jul 22 02:07:27.850813 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.850600 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerStarted","Data":"1f3bd66cef3f53504ab743f0afb218693434527bc3f7c41e9526a5f470d9907c"} Jul 22 02:07:27.873213 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:27.873153 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podStartSLOduration=1.873136632 podStartE2EDuration="1.873136632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:07:27.871471835 +0000 UTC m=+2365.926180475" watchObservedRunningTime="2026-07-22 02:07:27.873136632 +0000 UTC m=+2365.927845265" Jul 22 02:07:28.305869 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:28.305788 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:28.310915 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:28.310889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:28.855850 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:28.855817 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:28.856880 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:28.856857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:29.188280 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:29.188196 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:07:29.935919 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:29.935888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:30.014053 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:30.014016 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:30.075850 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:30.075818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:30.212183 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:30.212085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:30.506946 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:30.506845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:30.606451 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:30.606419 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:34.449896 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:34.449699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:41.295843 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:41.295803 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:07:43.338797 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.338699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:43.436571 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.436539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:43.857347 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.857314 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 22 02:07:43.857510 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.857370 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 22 02:07:43.940233 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.940204 2561 generic.go:356] "Generic (PLEG): container finished" podID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerID="19144f8cdedf4cd9c71b94b5ca49809ed9fc9ec93fbb434fa4b358f296200b3e" exitCode=0 Jul 22 02:07:43.940401 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.940261 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerDied","Data":"19144f8cdedf4cd9c71b94b5ca49809ed9fc9ec93fbb434fa4b358f296200b3e"} Jul 22 02:07:43.940677 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.940663 2561 scope.go:117] "RemoveContainer" containerID="19144f8cdedf4cd9c71b94b5ca49809ed9fc9ec93fbb434fa4b358f296200b3e" Jul 22 02:07:43.941630 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.941603 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:43.941692 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.941675 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:43.941732 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:43.941705 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 22 02:07:44.952305 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:44.952263 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerStarted","Data":"50823a0fe8f82fbf674bf2767049f394f1174745bb02bec7005bb24c20dfb03d"} Jul 22 02:07:45.305289 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:45.305192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:45.305434 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:45.305312 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 22 02:07:45.305434 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:45.305368 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 22 02:07:46.306107 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:46.306065 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 22 02:07:46.306584 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:46.306189 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 22 02:07:47.305576 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:47.305537 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 22 02:07:47.305754 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:47.305598 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 22 02:07:48.305302 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:48.305266 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= Jul 22 02:07:48.305798 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:48.305328 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" Jul 22 02:07:49.309602 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:49.309568 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:49.310039 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:49.309796 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:49.310520 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:49.310502 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:07:51.334808 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:51.334778 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:51.436042 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:07:51.436011 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:03.307575 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:03.307548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:08:03.310305 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:03.310285 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:08:05.857842 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:05.857802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:08.999463 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:08.999432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:08:25.132517 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:25.132417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:30.219734 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:30.219697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:30.272701 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:30.272668 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:58.937653 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:58.937604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:58.993819 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:58.993781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:08:59.834857 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:08:59.834819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:09:03.282102 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:09:03.282067 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:09:27.989044 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:09:27.989000 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:09:46.998712 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:09:46.998674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:10:03.412021 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:03.411939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:10:21.088956 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:21.088922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:10:40.497814 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:40.497776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:10:48.404808 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:48.404745 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:57.784445 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:57.784394 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:58.896952 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:10:58.896916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:11:13.355169 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:11:13.355129 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:11:14.475228 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:11:14.475186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:11:17.492824 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:11:17.492789 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:11:32.961029 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:11:32.960932 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:11:36.191866 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:11:36.191822 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:12:02.850725 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:02.850682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:03.434123 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:03.434090 2561 scope.go:117] "RemoveContainer" containerID="1ad77c22b252c3073281f949b5efe4b41cbb472e5df1504e81c105f22c81709c" Jul 22 02:12:05.902473 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:05.902439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:12:25.170348 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:25.170310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:25.268680 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:25.268643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:26.283145 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:26.283112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:12:44.092742 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:44.092700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:44.209083 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:44.209041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:44.692547 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:44.692518 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:12:50.585984 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:50.585953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:51.461060 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:51.461002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:52.077382 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:52.077350 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:52.175967 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:12:52.175934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:02.103467 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:02.103392 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:13:03.344455 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:03.344429 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:13:03.348883 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:03.348863 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2q9k_d2940268-f222-4619-9cdf-6c9455ca6555/ovn-acl-logging/0.log" Jul 22 02:13:07.333035 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:07.332988 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:12.295920 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:12.295888 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:13:29.153088 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:29.153041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:33.093577 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:33.093539 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:13:41.049832 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:13:41.049749 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:12.287640 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:12.287604 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:14:27.589650 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:27.589433 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:14:35.149348 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:35.149307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:36.020138 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:36.020103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:37.123405 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.123366 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-140270238383408"] Jul 22 02:14:37.123896 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.123879 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db8bb62-1db0-4e67-9f36-b0887241f662" containerName="istio-proxy" Jul 22 02:14:37.127049 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.127032 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:37.129535 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.129514 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7vgx\"" Jul 22 02:14:37.133478 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.133453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238383408"] Jul 22 02:14:37.280130 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.280097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gqz\" (UniqueName: \"kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz\") pod \"test-curl-7655-140270238383408\" (UID: \"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3\") " pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:37.381159 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.381073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gqz\" (UniqueName: \"kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz\") pod \"test-curl-7655-140270238383408\" (UID: \"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3\") " pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:37.389567 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.389544 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gqz\" (UniqueName: \"kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz\") pod \"test-curl-7655-140270238383408\" (UID: \"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3\") " pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:37.438652 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.438623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:37.569739 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.569713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238383408"] Jul 22 02:14:37.571715 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:14:37.571690 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d54a755_adc1_45bf_a8a8_d43d61c2b6a3.slice/crio-24b828ca354e564d0755120dc74ab847674c40056c2ce4f49cf25d0aa9f8e34c WatchSource:0}: Error finding container 24b828ca354e564d0755120dc74ab847674c40056c2ce4f49cf25d0aa9f8e34c: Status 404 returned error can't find the container with id 24b828ca354e564d0755120dc74ab847674c40056c2ce4f49cf25d0aa9f8e34c Jul 22 02:14:37.573019 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:37.573002 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:14:38.220366 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:38.220332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238383408" event={"ID":"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3","Type":"ContainerStarted","Data":"24b828ca354e564d0755120dc74ab847674c40056c2ce4f49cf25d0aa9f8e34c"} Jul 22 02:14:39.227086 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:39.227051 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" containerID="fc6241187e524727f2b9a0d7c7da9badd123824f8e91d1f3f9c1a9e83558b726" exitCode=0 Jul 22 02:14:39.227495 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:39.227141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238383408" event={"ID":"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3","Type":"ContainerDied","Data":"fc6241187e524727f2b9a0d7c7da9badd123824f8e91d1f3f9c1a9e83558b726"} Jul 22 02:14:40.365988 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.365966 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:40.387058 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.387031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7655-140270238383408_0d54a755-adc1-45bf-a8a8-d43d61c2b6a3/test-curl-7655-140270238383408/0.log" Jul 22 02:14:40.417674 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.416811 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-140270238383408"] Jul 22 02:14:40.422702 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.422665 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-140270238383408"] Jul 22 02:14:40.511604 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.511518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7gqz\" (UniqueName: \"kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz\") pod \"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3\" (UID: \"0d54a755-adc1-45bf-a8a8-d43d61c2b6a3\") " Jul 22 02:14:40.513695 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.513672 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz" (OuterVolumeSpecName: "kube-api-access-m7gqz") pod "0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" (UID: "0d54a755-adc1-45bf-a8a8-d43d61c2b6a3"). InnerVolumeSpecName "kube-api-access-m7gqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:40.572330 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.572286 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-140270238383920"] Jul 22 02:14:40.572913 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.572893 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" containerName="test-curl-7655-140270238383408" Jul 22 02:14:40.572913 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.572914 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" containerName="test-curl-7655-140270238383408" Jul 22 02:14:40.573031 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.572996 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" containerName="test-curl-7655-140270238383408" Jul 22 02:14:40.576032 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.576010 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:40.582160 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.582135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238383920"] Jul 22 02:14:40.612954 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.612924 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7gqz\" (UniqueName: \"kubernetes.io/projected/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3-kube-api-access-m7gqz\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:14:40.714045 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.714003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhx8\" (UniqueName: \"kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8\") pod \"test-curl-7655-140270238383920\" (UID: \"680a7123-1fce-4c13-994f-be7c45ef5f19\") " pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:40.815292 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.815200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhx8\" (UniqueName: \"kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8\") pod \"test-curl-7655-140270238383920\" (UID: \"680a7123-1fce-4c13-994f-be7c45ef5f19\") " pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:40.823483 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.823460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhx8\" (UniqueName: \"kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8\") pod \"test-curl-7655-140270238383920\" (UID: \"680a7123-1fce-4c13-994f-be7c45ef5f19\") " pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:40.886499 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:40.886462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:41.026701 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:41.026675 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238383920"] Jul 22 02:14:41.028249 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:14:41.028226 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod680a7123_1fce_4c13_994f_be7c45ef5f19.slice/crio-32c30bfaabf665241b85e185fac8468f4ace44fc07faa7ca376971c23ece646b WatchSource:0}: Error finding container 32c30bfaabf665241b85e185fac8468f4ace44fc07faa7ca376971c23ece646b: Status 404 returned error can't find the container with id 32c30bfaabf665241b85e185fac8468f4ace44fc07faa7ca376971c23ece646b Jul 22 02:14:41.240210 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:41.240182 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:41.240369 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:41.240223 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24b828ca354e564d0755120dc74ab847674c40056c2ce4f49cf25d0aa9f8e34c" Jul 22 02:14:41.241477 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:41.241448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238383920" event={"ID":"680a7123-1fce-4c13-994f-be7c45ef5f19","Type":"ContainerStarted","Data":"32c30bfaabf665241b85e185fac8468f4ace44fc07faa7ca376971c23ece646b"} Jul 22 02:14:41.251190 ip-10-0-136-148 kubenswrapper[2561]: E0722 02:14:41.251164 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7655-140270238383408\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" pod="opendatahub/test-curl-7655-140270238383408" Jul 22 02:14:42.097703 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:42.097670 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d54a755-adc1-45bf-a8a8-d43d61c2b6a3" path="/var/lib/kubelet/pods/0d54a755-adc1-45bf-a8a8-d43d61c2b6a3/volumes" Jul 22 02:14:42.248330 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:42.248293 2561 generic.go:356] "Generic (PLEG): container finished" podID="680a7123-1fce-4c13-994f-be7c45ef5f19" containerID="c40ef7b57ec3b28cef2765cb397cabe831308999fbb78a32b271b613b7a494f6" exitCode=0 Jul 22 02:14:42.248502 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:42.248356 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238383920" event={"ID":"680a7123-1fce-4c13-994f-be7c45ef5f19","Type":"ContainerDied","Data":"c40ef7b57ec3b28cef2765cb397cabe831308999fbb78a32b271b613b7a494f6"} Jul 22 02:14:43.390594 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.390568 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:43.412779 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.412735 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7655-140270238383920_680a7123-1fce-4c13-994f-be7c45ef5f19/test-curl-7655-140270238383920/0.log" Jul 22 02:14:43.437574 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.437542 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-140270238383920"] Jul 22 02:14:43.443124 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.443098 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-140270238383920"] Jul 22 02:14:43.540357 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.540274 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkhx8\" (UniqueName: \"kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8\") pod \"680a7123-1fce-4c13-994f-be7c45ef5f19\" (UID: \"680a7123-1fce-4c13-994f-be7c45ef5f19\") " Jul 22 02:14:43.542335 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.542309 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8" (OuterVolumeSpecName: "kube-api-access-jkhx8") pod "680a7123-1fce-4c13-994f-be7c45ef5f19" (UID: "680a7123-1fce-4c13-994f-be7c45ef5f19"). InnerVolumeSpecName "kube-api-access-jkhx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:43.636471 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.636436 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:43.636829 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.636815 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680a7123-1fce-4c13-994f-be7c45ef5f19" containerName="test-curl-7655-140270238383920" Jul 22 02:14:43.636829 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.636829 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="680a7123-1fce-4c13-994f-be7c45ef5f19" containerName="test-curl-7655-140270238383920" Jul 22 02:14:43.636965 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.636910 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="680a7123-1fce-4c13-994f-be7c45ef5f19" containerName="test-curl-7655-140270238383920" Jul 22 02:14:43.639833 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.639815 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:43.641060 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.641013 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkhx8\" (UniqueName: \"kubernetes.io/projected/680a7123-1fce-4c13-994f-be7c45ef5f19-kube-api-access-jkhx8\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:14:43.646947 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.646920 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:43.741893 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.741862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgv9m\" (UniqueName: \"kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m\") pod \"test-curl-7655-140270238245920\" (UID: \"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:43.842717 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.842681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgv9m\" (UniqueName: \"kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m\") pod \"test-curl-7655-140270238245920\" (UID: \"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:43.850332 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.850306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgv9m\" (UniqueName: \"kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m\") pod \"test-curl-7655-140270238245920\" (UID: \"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:43.950675 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:43.950639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:44.079093 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:44.079061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:44.080712 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:14:44.080686 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfea5ae9_f9e4_448b_b0f4_5a0fea0eb7e6.slice/crio-4445679c82a641b51df7182d7a1f1479f260bad498b921a8fcf9f66ff1ce7464 WatchSource:0}: Error finding container 4445679c82a641b51df7182d7a1f1479f260bad498b921a8fcf9f66ff1ce7464: Status 404 returned error can't find the container with id 4445679c82a641b51df7182d7a1f1479f260bad498b921a8fcf9f66ff1ce7464 Jul 22 02:14:44.097143 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:44.097090 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="680a7123-1fce-4c13-994f-be7c45ef5f19" path="/var/lib/kubelet/pods/680a7123-1fce-4c13-994f-be7c45ef5f19/volumes" Jul 22 02:14:44.260952 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:44.260924 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238383920" Jul 22 02:14:44.261123 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:44.260931 2561 scope.go:117] "RemoveContainer" containerID="c40ef7b57ec3b28cef2765cb397cabe831308999fbb78a32b271b613b7a494f6" Jul 22 02:14:44.262282 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:44.262256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238245920" event={"ID":"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6","Type":"ContainerStarted","Data":"4445679c82a641b51df7182d7a1f1479f260bad498b921a8fcf9f66ff1ce7464"} Jul 22 02:14:45.270030 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:45.269991 2561 generic.go:356] "Generic (PLEG): container finished" podID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" containerID="dbf3a3c0bbf882bdcbf328142bfd6ca3ec0e92270788c1bb24b37994b53a792a" exitCode=0 Jul 22 02:14:45.270416 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:45.270054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238245920" event={"ID":"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6","Type":"ContainerDied","Data":"dbf3a3c0bbf882bdcbf328142bfd6ca3ec0e92270788c1bb24b37994b53a792a"} Jul 22 02:14:46.414280 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.414254 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:46.438508 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.438484 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7655-140270238245920_dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6/test-curl-7655-140270238245920/0.log" Jul 22 02:14:46.463089 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.463057 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:46.468278 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.468248 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:46.565579 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.565500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgv9m\" (UniqueName: \"kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m\") pod \"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6\" (UID: \"dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6\") " Jul 22 02:14:46.567559 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.567533 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m" (OuterVolumeSpecName: "kube-api-access-cgv9m") pod "dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" (UID: "dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6"). InnerVolumeSpecName "kube-api-access-cgv9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:46.594789 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.594746 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:46.595137 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.595125 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" containerName="test-curl-7655-140270238245920" Jul 22 02:14:46.595181 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.595139 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" containerName="test-curl-7655-140270238245920" Jul 22 02:14:46.595217 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.595208 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" containerName="test-curl-7655-140270238245920" Jul 22 02:14:46.598209 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.598193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:46.603983 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.603957 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:46.666869 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.666842 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgv9m\" (UniqueName: \"kubernetes.io/projected/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6-kube-api-access-cgv9m\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:14:46.767976 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.767941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgzk\" (UniqueName: \"kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk\") pod \"test-curl-7655-140270238245920\" (UID: \"f90690ec-23fc-471b-8db1-c0a5796432d2\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:46.869197 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.869161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgzk\" (UniqueName: \"kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk\") pod \"test-curl-7655-140270238245920\" (UID: \"f90690ec-23fc-471b-8db1-c0a5796432d2\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:46.877374 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.877343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgzk\" (UniqueName: \"kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk\") pod \"test-curl-7655-140270238245920\" (UID: \"f90690ec-23fc-471b-8db1-c0a5796432d2\") " pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:46.908991 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:46.908956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:47.050543 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:47.050517 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:47.051889 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:14:47.051860 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf90690ec_23fc_471b_8db1_c0a5796432d2.slice/crio-b89a1009dc51e8c11c59997772d8277baacd3b38230cb022cd51d82d91671034 WatchSource:0}: Error finding container b89a1009dc51e8c11c59997772d8277baacd3b38230cb022cd51d82d91671034: Status 404 returned error can't find the container with id b89a1009dc51e8c11c59997772d8277baacd3b38230cb022cd51d82d91671034 Jul 22 02:14:47.283866 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:47.283750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238245920" event={"ID":"f90690ec-23fc-471b-8db1-c0a5796432d2","Type":"ContainerStarted","Data":"b89a1009dc51e8c11c59997772d8277baacd3b38230cb022cd51d82d91671034"} Jul 22 02:14:47.284914 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:47.284896 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4445679c82a641b51df7182d7a1f1479f260bad498b921a8fcf9f66ff1ce7464" Jul 22 02:14:47.285021 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:47.284928 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:47.296476 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:47.296450 2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7655-140270238245920" oldPodUID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" podUID="f90690ec-23fc-471b-8db1-c0a5796432d2" Jul 22 02:14:48.098179 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:48.098148 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6" path="/var/lib/kubelet/pods/dfea5ae9-f9e4-448b-b0f4-5a0fea0eb7e6/volumes" Jul 22 02:14:48.292122 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:48.292081 2561 generic.go:356] "Generic (PLEG): container finished" podID="f90690ec-23fc-471b-8db1-c0a5796432d2" containerID="83011a3aac31358e254222fc6738c5a9d1d4d0e7c88b723c9fc3ff4559fa66e8" exitCode=0 Jul 22 02:14:48.292291 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:48.292158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238245920" event={"ID":"f90690ec-23fc-471b-8db1-c0a5796432d2","Type":"ContainerDied","Data":"83011a3aac31358e254222fc6738c5a9d1d4d0e7c88b723c9fc3ff4559fa66e8"} Jul 22 02:14:48.897439 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:48.897399 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:14:49.432207 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.432174 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:49.452945 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.452917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7655-140270238245920_f90690ec-23fc-471b-8db1-c0a5796432d2/test-curl-7655-140270238245920/0.log" Jul 22 02:14:49.477478 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.477447 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:49.481425 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.481401 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-140270238245920"] Jul 22 02:14:49.593826 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.593801 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgzk\" (UniqueName: \"kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk\") pod \"f90690ec-23fc-471b-8db1-c0a5796432d2\" (UID: \"f90690ec-23fc-471b-8db1-c0a5796432d2\") " Jul 22 02:14:49.595859 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.595833 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk" (OuterVolumeSpecName: "kube-api-access-srgzk") pod "f90690ec-23fc-471b-8db1-c0a5796432d2" (UID: "f90690ec-23fc-471b-8db1-c0a5796432d2"). InnerVolumeSpecName "kube-api-access-srgzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:49.610709 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.610687 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-140270238246928"] Jul 22 02:14:49.611111 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.611094 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90690ec-23fc-471b-8db1-c0a5796432d2" containerName="test-curl-7655-140270238245920" Jul 22 02:14:49.611157 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.611112 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90690ec-23fc-471b-8db1-c0a5796432d2" containerName="test-curl-7655-140270238245920" Jul 22 02:14:49.611210 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.611199 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90690ec-23fc-471b-8db1-c0a5796432d2" containerName="test-curl-7655-140270238245920" Jul 22 02:14:49.614094 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.614079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:49.619290 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.619261 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238246928"] Jul 22 02:14:49.695050 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.695013 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgzk\" (UniqueName: \"kubernetes.io/projected/f90690ec-23fc-471b-8db1-c0a5796432d2-kube-api-access-srgzk\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:14:49.795840 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.795805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4hc\" (UniqueName: \"kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc\") pod \"test-curl-7655-140270238246928\" (UID: \"0b4f3d2e-9565-48fc-9cae-28d3effa123b\") " pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:49.896467 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.896374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4hc\" (UniqueName: \"kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc\") pod \"test-curl-7655-140270238246928\" (UID: \"0b4f3d2e-9565-48fc-9cae-28d3effa123b\") " pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:49.905485 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.905456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4hc\" (UniqueName: \"kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc\") pod \"test-curl-7655-140270238246928\" (UID: \"0b4f3d2e-9565-48fc-9cae-28d3effa123b\") " pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:49.925917 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:49.925887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:50.083961 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:50.083890 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-140270238246928"] Jul 22 02:14:50.086108 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:14:50.086081 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b4f3d2e_9565_48fc_9cae_28d3effa123b.slice/crio-a3e170304c35dca224466a450e88f5edef561041c1e89b7c552f4cc7d90f737b WatchSource:0}: Error finding container a3e170304c35dca224466a450e88f5edef561041c1e89b7c552f4cc7d90f737b: Status 404 returned error can't find the container with id a3e170304c35dca224466a450e88f5edef561041c1e89b7c552f4cc7d90f737b Jul 22 02:14:50.097995 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:50.097972 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f90690ec-23fc-471b-8db1-c0a5796432d2" path="/var/lib/kubelet/pods/f90690ec-23fc-471b-8db1-c0a5796432d2/volumes" Jul 22 02:14:50.304046 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:50.303968 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238245920" Jul 22 02:14:50.304198 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:50.303975 2561 scope.go:117] "RemoveContainer" containerID="83011a3aac31358e254222fc6738c5a9d1d4d0e7c88b723c9fc3ff4559fa66e8" Jul 22 02:14:50.305411 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:50.305384 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238246928" event={"ID":"0b4f3d2e-9565-48fc-9cae-28d3effa123b","Type":"ContainerStarted","Data":"a3e170304c35dca224466a450e88f5edef561041c1e89b7c552f4cc7d90f737b"} Jul 22 02:14:51.312944 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:51.312914 2561 generic.go:356] "Generic (PLEG): container finished" podID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" containerID="1f70ea36d3ab87b8f3f454327a612d4043476fe54699671f0c8b54ff02f49506" exitCode=0 Jul 22 02:14:51.313323 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:51.313001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-140270238246928" event={"ID":"0b4f3d2e-9565-48fc-9cae-28d3effa123b","Type":"ContainerDied","Data":"1f70ea36d3ab87b8f3f454327a612d4043476fe54699671f0c8b54ff02f49506"} Jul 22 02:14:52.458459 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.458435 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:52.478569 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.478526 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7655-140270238246928_0b4f3d2e-9565-48fc-9cae-28d3effa123b/test-curl-7655-140270238246928/0.log" Jul 22 02:14:52.503981 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.503952 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-140270238246928"] Jul 22 02:14:52.508382 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.508354 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-140270238246928"] Jul 22 02:14:52.622879 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.622848 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr4hc\" (UniqueName: \"kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc\") pod \"0b4f3d2e-9565-48fc-9cae-28d3effa123b\" (UID: \"0b4f3d2e-9565-48fc-9cae-28d3effa123b\") " Jul 22 02:14:52.625005 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.624974 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc" (OuterVolumeSpecName: "kube-api-access-fr4hc") pod "0b4f3d2e-9565-48fc-9cae-28d3effa123b" (UID: "0b4f3d2e-9565-48fc-9cae-28d3effa123b"). InnerVolumeSpecName "kube-api-access-fr4hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:52.724547 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:52.724510 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr4hc\" (UniqueName: \"kubernetes.io/projected/0b4f3d2e-9565-48fc-9cae-28d3effa123b-kube-api-access-fr4hc\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:14:53.328484 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:53.328453 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:53.328484 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:53.328466 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3e170304c35dca224466a450e88f5edef561041c1e89b7c552f4cc7d90f737b" Jul 22 02:14:53.338432 ip-10-0-136-148 kubenswrapper[2561]: E0722 02:14:53.338404 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7655-140270238246928\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:54.100091 ip-10-0-136-148 kubenswrapper[2561]: E0722 02:14:54.100046 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7655-140270238246928\" is forbidden: User \"system:node:ip-10-0-136-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-148.ec2.internal' and this object" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" pod="opendatahub/test-curl-7655-140270238246928" Jul 22 02:14:54.103943 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:54.103916 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" path="/var/lib/kubelet/pods/0b4f3d2e-9565-48fc-9cae-28d3effa123b/volumes" Jul 22 02:14:56.971870 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:56.971826 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:57.072968 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:14:57.072932 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:03.820617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:03.820530 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:06.791251 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:06.791212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:09.895352 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:09.895309 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:15:11.372691 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:11.372651 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:11.844204 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:11.844169 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:17.997461 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:17.997425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:18.054392 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:18.054362 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:18.283982 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:18.283892 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:18.536407 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:18.536319 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:19.296515 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:19.296476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:19.397199 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:19.397162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:29.113125 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:29.113079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:31.991252 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:31.991220 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dksw5"] Jul 22 02:15:33.735040 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:33.734997 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:34.164965 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:34.164936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:40.155952 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.155919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:40.216316 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.216283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:40.422495 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.422397 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:15:40.422661 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.422634 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" containerID="cri-o://50823a0fe8f82fbf674bf2767049f394f1174745bb02bec7005bb24c20dfb03d" gracePeriod=30 Jul 22 02:15:40.438442 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.438404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:40.701659 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:40.701571 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:41.199222 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:41.199177 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f85d45f7f-rwlbm_f9bbe6ac-03d8-4a28-a087-1c2882a9920b/authorino/0.log" Jul 22 02:15:45.616795 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.616731 2561 generic.go:356] "Generic (PLEG): container finished" podID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerID="50823a0fe8f82fbf674bf2767049f394f1174745bb02bec7005bb24c20dfb03d" exitCode=0 Jul 22 02:15:45.617166 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.616807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerDied","Data":"50823a0fe8f82fbf674bf2767049f394f1174745bb02bec7005bb24c20dfb03d"} Jul 22 02:15:45.617166 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.616893 2561 scope.go:117] "RemoveContainer" containerID="19144f8cdedf4cd9c71b94b5ca49809ed9fc9ec93fbb434fa4b358f296200b3e" Jul 22 02:15:45.677582 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.677558 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:15:45.712695 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712632 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.712695 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712664 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.712865 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712785 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.712865 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712838 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.712959 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712903 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.713012 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712970 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.713012 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.712974 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:45.713124 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713028 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.713124 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713054 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.713124 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713089 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47s88\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88\") pod \"eead7531-181d-40e0-9ccd-4d96deb7d8da\" (UID: \"eead7531-181d-40e0-9ccd-4d96deb7d8da\") " Jul 22 02:15:45.713289 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713162 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:15:45.713346 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713318 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:45.713488 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713432 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-certs\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.713488 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713451 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eead7531-181d-40e0-9ccd-4d96deb7d8da-istiod-ca-cert\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.713488 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713465 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-credential-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.713812 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.713784 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:45.714053 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.714026 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data" (OuterVolumeSpecName: "istio-data") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:45.715107 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.715083 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:45.715107 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.715101 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token" (OuterVolumeSpecName: "istio-token") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:15:45.715351 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.715337 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:15:45.715572 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.715548 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88" (OuterVolumeSpecName: "kube-api-access-47s88") pod "eead7531-181d-40e0-9ccd-4d96deb7d8da" (UID: "eead7531-181d-40e0-9ccd-4d96deb7d8da"). InnerVolumeSpecName "kube-api-access-47s88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:15:45.814373 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814338 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-data\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.814373 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814370 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47s88\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-kube-api-access-47s88\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.814588 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814392 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-token\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.814588 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814401 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-envoy\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.814588 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814409 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eead7531-181d-40e0-9ccd-4d96deb7d8da-istio-podinfo\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:45.814588 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:45.814416 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eead7531-181d-40e0-9ccd-4d96deb7d8da-workload-socket\") on node \"ip-10-0-136-148.ec2.internal\" DevicePath \"\"" Jul 22 02:15:46.623367 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:46.623338 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" Jul 22 02:15:46.623795 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:46.623381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg" event={"ID":"eead7531-181d-40e0-9ccd-4d96deb7d8da","Type":"ContainerDied","Data":"1f3bd66cef3f53504ab743f0afb218693434527bc3f7c41e9526a5f470d9907c"} Jul 22 02:15:46.623795 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:46.623434 2561 scope.go:117] "RemoveContainer" containerID="50823a0fe8f82fbf674bf2767049f394f1174745bb02bec7005bb24c20dfb03d" Jul 22 02:15:46.643987 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:46.643960 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:15:46.652855 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:46.652827 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1f4af7-openshift-default-7b59454b4c-tgclg"] Jul 22 02:15:47.498335 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:47.498307 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w8wqz_bc1262e6-2185-433e-a1d9-277d040925ac/server/0.log" Jul 22 02:15:48.006054 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:48.006024 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-xft5d_98e3b98e-039f-4c7d-a2fe-5b406f6441a8/copy-manifests/0.log" Jul 22 02:15:48.025871 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:48.025840 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-xft5d_98e3b98e-039f-4c7d-a2fe-5b406f6441a8/manager/0.log" Jul 22 02:15:48.097711 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:48.097672 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" path="/var/lib/kubelet/pods/eead7531-181d-40e0-9ccd-4d96deb7d8da/volumes" Jul 22 02:15:49.772383 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.772353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/util/0.log" Jul 22 02:15:49.779654 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.779634 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/pull/0.log" Jul 22 02:15:49.786378 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.786330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/extract/0.log" Jul 22 02:15:49.911058 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.911028 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/pull/0.log" Jul 22 02:15:49.917673 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.917637 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/extract/0.log" Jul 22 02:15:49.923789 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:49.923750 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/util/0.log" Jul 22 02:15:50.050338 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.050240 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/util/0.log" Jul 22 02:15:50.056902 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.056859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/pull/0.log" Jul 22 02:15:50.081254 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.081227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/extract/0.log" Jul 22 02:15:50.201035 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.201008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/extract/0.log" Jul 22 02:15:50.207302 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.207276 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/util/0.log" Jul 22 02:15:50.213574 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.213551 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/pull/0.log" Jul 22 02:15:50.341606 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.341566 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f85d45f7f-rwlbm_f9bbe6ac-03d8-4a28-a087-1c2882a9920b/authorino/0.log" Jul 22 02:15:50.467956 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.467925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pc6dc_7f794a17-fb6f-466f-9022-b7baccb7f87e/manager/0.log" Jul 22 02:15:50.858269 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.858235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xcm67_bd249680-d71e-4fb7-8154-98b62e1810b8/registry-server/0.log" Jul 22 02:15:50.998384 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:50.998353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fz67v_05a1c8ff-f847-40b3-acac-209542f4a1fb/manager/0.log" Jul 22 02:15:51.121363 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:51.121273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dksw5_ea738949-49f6-41d4-a766-a1c46714745e/limitador/0.log" Jul 22 02:15:51.644127 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:51.644101 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rp6k7_4a432763-81d3-449b-bc26-54ecbff3be78/istio-proxy/0.log" Jul 22 02:15:52.139692 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:52.139657 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/1.log" Jul 22 02:15:53.280413 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:53.280372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5pxm_e8edf329-a7e8-46b1-8005-88245d2e0df2/main/0.log" Jul 22 02:15:54.406624 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:54.406536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:59.849390 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:59.849353 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:59.943039 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:15:59.943002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:02.473811 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:02.473779 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s68xt_daf4dc7f-305c-4a80-aea3-c50e8fc9dab0/global-pull-secret-syncer/0.log" Jul 22 02:16:02.533631 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:02.533602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g9cz4_0c493b7b-cb77-4a29-996f-136de222324c/konnectivity-agent/0.log" Jul 22 02:16:02.658568 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:02.658539 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-148.ec2.internal_3581e57e834108d06c1d0f1f0066af56/haproxy/0.log" Jul 22 02:16:06.240396 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.240362 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/extract/0.log" Jul 22 02:16:06.268147 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.268114 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/util/0.log" Jul 22 02:16:06.308394 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.308367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tqqkc_3e9a0cd9-6f7e-4655-b7e0-975297765d07/pull/0.log" Jul 22 02:16:06.333879 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.333852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/extract/0.log" Jul 22 02:16:06.363877 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.363850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/util/0.log" Jul 22 02:16:06.389612 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.389587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pxmlf_c40b065e-c5b5-40c0-8947-8367f0688a5a/pull/0.log" Jul 22 02:16:06.418929 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.418907 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/extract/0.log" Jul 22 02:16:06.442652 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.442629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/util/0.log" Jul 22 02:16:06.474394 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.474347 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bvnzj_b8125e2c-e069-4b7a-bdd0-abe8ff50b1c1/pull/0.log" Jul 22 02:16:06.500655 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.500585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/extract/0.log" Jul 22 02:16:06.530648 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.530626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/util/0.log" Jul 22 02:16:06.564275 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:06.564252 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s7pvw_766dacf5-8aaf-4d9a-abff-1c2853059232/pull/0.log" Jul 22 02:16:07.206553 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:07.206527 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f85d45f7f-rwlbm_f9bbe6ac-03d8-4a28-a087-1c2882a9920b/authorino/0.log" Jul 22 02:16:07.248520 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:07.248489 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pc6dc_7f794a17-fb6f-466f-9022-b7baccb7f87e/manager/0.log" Jul 22 02:16:07.380801 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:07.380750 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xcm67_bd249680-d71e-4fb7-8154-98b62e1810b8/registry-server/0.log" Jul 22 02:16:07.634654 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:07.634619 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fz67v_05a1c8ff-f847-40b3-acac-209542f4a1fb/manager/0.log" Jul 22 02:16:07.687477 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:07.687448 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dksw5_ea738949-49f6-41d4-a766-a1c46714745e/limitador/0.log" Jul 22 02:16:09.259372 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.259299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/alertmanager/0.log" Jul 22 02:16:09.286188 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.286165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/config-reloader/0.log" Jul 22 02:16:09.310102 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.310078 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/kube-rbac-proxy-web/0.log" Jul 22 02:16:09.333137 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.333111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/kube-rbac-proxy/0.log" Jul 22 02:16:09.368459 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.368426 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/kube-rbac-proxy-metric/0.log" Jul 22 02:16:09.392835 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.392811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/prom-label-proxy/0.log" Jul 22 02:16:09.419195 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.419168 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a443ed9e-2c47-4ddb-9706-d1bc27766653/init-config-reloader/0.log" Jul 22 02:16:09.489820 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.489782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m445w_bae6ecb7-80d7-4756-ace1-632ffb5175a6/kube-state-metrics/0.log" Jul 22 02:16:09.512903 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.512835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m445w_bae6ecb7-80d7-4756-ace1-632ffb5175a6/kube-rbac-proxy-main/0.log" Jul 22 02:16:09.533532 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.533503 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m445w_bae6ecb7-80d7-4756-ace1-632ffb5175a6/kube-rbac-proxy-self/0.log" Jul 22 02:16:09.806797 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.806695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjbbk_d16fb160-09fa-415e-8f97-0773c287fa82/node-exporter/0.log" Jul 22 02:16:09.829539 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.829512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjbbk_d16fb160-09fa-415e-8f97-0773c287fa82/kube-rbac-proxy/0.log" Jul 22 02:16:09.853139 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:09.853114 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jjbbk_d16fb160-09fa-415e-8f97-0773c287fa82/init-textfile/0.log" Jul 22 02:16:10.160909 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.160877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qn9s4_80913475-6d03-4565-9474-e44087346fed/prometheus-operator/0.log" Jul 22 02:16:10.177691 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.177666 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-qn9s4_80913475-6d03-4565-9474-e44087346fed/kube-rbac-proxy/0.log" Jul 22 02:16:10.239250 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.239216 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68849f849c-jssv7_b7e1e998-52c3-463c-b4ff-91b8950f9a9b/telemeter-client/0.log" Jul 22 02:16:10.261535 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.261508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68849f849c-jssv7_b7e1e998-52c3-463c-b4ff-91b8950f9a9b/reload/0.log" Jul 22 02:16:10.284196 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.284171 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68849f849c-jssv7_b7e1e998-52c3-463c-b4ff-91b8950f9a9b/kube-rbac-proxy/0.log" Jul 22 02:16:10.317275 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.317249 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/thanos-query/0.log" Jul 22 02:16:10.339626 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.339606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/kube-rbac-proxy-web/0.log" Jul 22 02:16:10.367547 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.367523 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/kube-rbac-proxy/0.log" Jul 22 02:16:10.390055 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.390036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/prom-label-proxy/0.log" Jul 22 02:16:10.415100 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.415046 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/kube-rbac-proxy-rules/0.log" Jul 22 02:16:10.437566 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:10.437524 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c76b677f6-6s279_8fb8dbe0-9f99-496e-a909-731bdd3f3b3f/kube-rbac-proxy-metrics/0.log" Jul 22 02:16:11.745352 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.745315 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9"] Jul 22 02:16:11.746018 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.745990 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.746018 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746017 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746032 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" containerName="test-curl-7655-140270238246928" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746042 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" containerName="test-curl-7655-140270238246928" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746066 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746075 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746182 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b4f3d2e-9565-48fc-9cae-28d3effa123b" containerName="test-curl-7655-140270238246928" Jul 22 02:16:11.746205 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746202 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.746499 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.746213 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eead7531-181d-40e0-9ccd-4d96deb7d8da" containerName="istio-proxy" Jul 22 02:16:11.749313 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.749297 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.751730 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.751708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvctt\"/\"kube-root-ca.crt\"" Jul 22 02:16:11.751853 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.751799 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvctt\"/\"openshift-service-ca.crt\"" Jul 22 02:16:11.752563 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.752548 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bvctt\"/\"default-dockercfg-zqgnq\"" Jul 22 02:16:11.759557 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.759533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9"] Jul 22 02:16:11.845823 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.845785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-podres\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.846004 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.845859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wm77\" (UniqueName: \"kubernetes.io/projected/c59a189d-49df-4233-9996-ccbfadc70a8f-kube-api-access-9wm77\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.846004 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.845901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-proc\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.846004 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.845942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-lib-modules\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.846004 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.845991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-sys\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946436 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-proc\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-lib-modules\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-sys\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946517 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-proc\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-podres\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wm77\" (UniqueName: \"kubernetes.io/projected/c59a189d-49df-4233-9996-ccbfadc70a8f-kube-api-access-9wm77\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946617 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-sys\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946886 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946633 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-podres\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.946886 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.946634 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59a189d-49df-4233-9996-ccbfadc70a8f-lib-modules\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:11.954664 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:11.954636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wm77\" (UniqueName: \"kubernetes.io/projected/c59a189d-49df-4233-9996-ccbfadc70a8f-kube-api-access-9wm77\") pod \"perf-node-gather-daemonset-nzwg9\" (UID: \"c59a189d-49df-4233-9996-ccbfadc70a8f\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:12.060791 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.060681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:12.197091 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.197066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9"] Jul 22 02:16:12.199626 ip-10-0-136-148 kubenswrapper[2561]: W0722 02:16:12.199596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc59a189d_49df_4233_9996_ccbfadc70a8f.slice/crio-3b914628bf36ea1cd3b0a9781c83b69708e91a88d00fed79bb5e92116fa632a0 WatchSource:0}: Error finding container 3b914628bf36ea1cd3b0a9781c83b69708e91a88d00fed79bb5e92116fa632a0: Status 404 returned error can't find the container with id 3b914628bf36ea1cd3b0a9781c83b69708e91a88d00fed79bb5e92116fa632a0 Jul 22 02:16:12.768534 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.768420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" event={"ID":"c59a189d-49df-4233-9996-ccbfadc70a8f","Type":"ContainerStarted","Data":"9fbd76d4375c358e5a296a8b914b7e017080f14752f60eab7adf67cfac363962"} Jul 22 02:16:12.768534 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.768495 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" event={"ID":"c59a189d-49df-4233-9996-ccbfadc70a8f","Type":"ContainerStarted","Data":"3b914628bf36ea1cd3b0a9781c83b69708e91a88d00fed79bb5e92116fa632a0"} Jul 22 02:16:12.768988 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.768617 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:12.778425 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.778401 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9fb54cfb-tdk9n_9bc7a9fb-58f3-4295-8e17-464afd889676/console/0.log" Jul 22 02:16:12.788017 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.787972 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" podStartSLOduration=1.787957401 podStartE2EDuration="1.787957401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:12.785947339 +0000 UTC m=+2890.840655988" watchObservedRunningTime="2026-07-22 02:16:12.787957401 +0000 UTC m=+2890.842666028" Jul 22 02:16:12.824867 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:12.824836 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-8lxgj_4854143e-9cd8-4e7c-8532-3273931a06e1/download-server/0.log" Jul 22 02:16:14.540204 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:14.540179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cz9ft_cac3b160-94a9-4335-a328-925a16bb93af/dns/0.log" Jul 22 02:16:14.566575 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:14.566546 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cz9ft_cac3b160-94a9-4335-a328-925a16bb93af/kube-rbac-proxy/0.log" Jul 22 02:16:14.644446 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:14.644405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cgmc_f558526b-1890-41cc-bfd8-9e0ec8b41d8c/dns-node-resolver/0.log" Jul 22 02:16:15.303137 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:15.303108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbgqx_92dd4b92-7dd8-4da8-aeb5-84bf13ccdb39/node-ca/0.log" Jul 22 02:16:16.317251 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:16.317222 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rp6k7_4a432763-81d3-449b-bc26-54ecbff3be78/istio-proxy/0.log" Jul 22 02:16:16.556748 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:16.556713 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/0.log" Jul 22 02:16:16.605639 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:16.605611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/1.log" Jul 22 02:16:17.403094 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:17.403052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9ctcr_bcfcf477-5fcf-408c-bd7e-97cf0e9cb205/serve-healthcheck-canary/0.log" Jul 22 02:16:18.160868 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:18.160825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tpbrp_0dfd5c12-833d-418e-9d43-d93a6ffbc6ac/kube-rbac-proxy/0.log" Jul 22 02:16:18.185657 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:18.185632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tpbrp_0dfd5c12-833d-418e-9d43-d93a6ffbc6ac/exporter/0.log" Jul 22 02:16:18.213982 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:18.213957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tpbrp_0dfd5c12-833d-418e-9d43-d93a6ffbc6ac/extractor/0.log" Jul 22 02:16:18.786921 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:18.786889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-nzwg9" Jul 22 02:16:20.730487 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:20.730458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w8wqz_bc1262e6-2185-433e-a1d9-277d040925ac/server/0.log" Jul 22 02:16:21.065424 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:21.065395 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-xft5d_98e3b98e-039f-4c7d-a2fe-5b406f6441a8/manager/0.log" Jul 22 02:16:21.084061 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:21.084010 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-xft5d_98e3b98e-039f-4c7d-a2fe-5b406f6441a8/copy-manifests/0.log" Jul 22 02:16:21.338421 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:21.338390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rp6k7_4a432763-81d3-449b-bc26-54ecbff3be78/istio-proxy/0.log" Jul 22 02:16:21.501960 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:21.501928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/0.log" Jul 22 02:16:21.551713 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:21.551674 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/1.log" Jul 22 02:16:22.362343 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:22.362303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7898dc9f59-74tlz_4a0050ff-853a-41f2-9ad3-df3d9d70df2b/manager/0.log" Jul 22 02:16:22.732554 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:22.732525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rp6k7_4a432763-81d3-449b-bc26-54ecbff3be78/istio-proxy/0.log" Jul 22 02:16:22.907554 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:22.907471 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/0.log" Jul 22 02:16:22.959584 ip-10-0-136-148 kubenswrapper[2561]: I0722 02:16:22.959553 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7nzh_5a61535e-3454-4c25-9cbb-0ac5afe0fc80/istio-proxy/1.log"