Jul 06 23:40:51.604368 ip-10-0-132-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 23:40:51.604381 ip-10-0-132-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 23:40:51.604388 ip-10-0-132-64 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 23:40:51.604720 ip-10-0-132-64 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 23:41:01.853763 ip-10-0-132-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 23:41:01.853783 ip-10-0-132-64 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1f42869593bc47d3b14218533a41d892 -- Jul 06 23:42:37.905326 ip-10-0-132-64 systemd[1]: Starting Kubernetes Kubelet... Jul 06 23:42:38.360221 ip-10-0-132-64 kubenswrapper[2600]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:42:38.360221 ip-10-0-132-64 kubenswrapper[2600]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 23:42:38.360221 ip-10-0-132-64 kubenswrapper[2600]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:42:38.360221 ip-10-0-132-64 kubenswrapper[2600]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 23:42:38.360221 ip-10-0-132-64 kubenswrapper[2600]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 23:42:38.360925 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.360290 2600 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 23:42:38.365695 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365656 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.365695 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365691 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.365695 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365697 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.365695 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365703 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.365922 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365709 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.366157 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.365719 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.366270 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366258 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.366270 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366270 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366273 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366277 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366281 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366284 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366287 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366290 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366292 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366295 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366297 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366300 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366303 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366305 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366310 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366316 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366320 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366323 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366330 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.366327 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366336 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366339 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366342 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366345 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366347 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366350 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366353 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366357 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366361 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366364 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366367 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366370 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366373 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366376 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366378 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366381 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366383 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366386 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366388 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366390 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.366751 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366393 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366396 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366398 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366401 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366403 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366406 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366409 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366412 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366414 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366416 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366419 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366421 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366425 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366428 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366431 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366434 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366436 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366439 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366441 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366444 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.367250 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366446 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366449 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366452 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366454 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366457 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366459 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366462 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366464 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366467 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366469 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366471 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366473 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366476 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366478 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366481 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366483 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366486 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366488 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366491 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366494 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.367726 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366496 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366499 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366501 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366504 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366506 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366509 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366512 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366515 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366517 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366520 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366523 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366526 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366528 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.366531 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367272 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367279 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367282 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367285 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367288 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.368223 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367290 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367293 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367296 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367298 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367301 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367303 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367306 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367309 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367311 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367314 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367316 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367319 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367321 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367324 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367326 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367330 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367333 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367335 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367338 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367341 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.368712 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367344 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367346 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367349 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367351 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367354 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367357 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367360 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367362 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367365 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367367 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367370 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367374 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367378 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367381 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367384 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367386 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367390 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367394 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367397 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.369220 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367400 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367403 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367406 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367408 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367411 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367413 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367417 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367419 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367422 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367424 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367426 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367430 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367434 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367436 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367439 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367441 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367444 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367447 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367449 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.369682 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367451 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367454 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367456 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367458 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367461 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367463 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367466 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367468 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367471 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367474 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367476 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367479 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367481 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367483 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367486 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367488 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367491 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367493 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367495 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367499 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.370158 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367502 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367504 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367507 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367510 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367512 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367515 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367517 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367519 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367522 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367524 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367527 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367529 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367532 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367534 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367537 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367539 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367914 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367919 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367921 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367924 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.370644 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367927 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367930 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367933 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367935 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367938 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367941 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367943 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367947 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367951 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367954 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367957 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367959 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367963 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367966 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367969 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367971 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367974 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367977 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367979 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.371155 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.367999 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368001 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368004 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368007 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368009 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368013 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368015 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368018 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368020 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368023 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368025 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368028 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368030 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368033 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368036 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368038 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368040 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368043 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368045 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368048 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.371609 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368050 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368053 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368055 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368057 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368060 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368062 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368065 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368068 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368070 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368073 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368075 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368077 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368081 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368083 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368085 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368088 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368093 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368095 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368097 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368100 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.372097 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368102 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368105 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368107 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368109 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368120 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368123 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368125 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368128 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368130 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368133 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368135 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368137 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368140 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368142 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368145 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368147 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368150 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368152 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368155 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368159 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.372692 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368161 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368164 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368166 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368169 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368171 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368174 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368176 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368179 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368183 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368187 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368190 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368193 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368196 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368200 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368203 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368205 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368277 2600 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368284 2600 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368291 2600 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368296 2600 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 23:42:38.373194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368302 2600 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368307 2600 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368315 2600 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368321 2600 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368326 2600 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368329 2600 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368332 2600 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368335 2600 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368338 2600 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368341 2600 flags.go:64] FLAG: --cgroup-root="" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368344 2600 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368347 2600 flags.go:64] FLAG: --client-ca-file="" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368351 2600 flags.go:64] FLAG: --cloud-provider="external" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368354 2600 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368358 2600 flags.go:64] FLAG: --cluster-domain="" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368360 2600 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368363 2600 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368366 2600 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368369 2600 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368373 2600 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368377 2600 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368380 2600 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368383 2600 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368387 2600 flags.go:64] FLAG: --contention-profiling="false" Jul 06 23:42:38.373706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368390 2600 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368392 2600 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368395 2600 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368398 2600 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368402 2600 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368405 2600 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368408 2600 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368411 2600 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368413 2600 flags.go:64] FLAG: --enable-server="true" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368416 2600 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368423 2600 flags.go:64] FLAG: --event-burst="100" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368426 2600 flags.go:64] FLAG: --event-qps="50" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368428 2600 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368431 2600 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368434 2600 flags.go:64] FLAG: --eviction-hard="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368438 2600 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368440 2600 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368443 2600 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368446 2600 flags.go:64] FLAG: --eviction-soft="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368449 2600 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368452 2600 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368455 2600 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368458 2600 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368460 2600 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368463 2600 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 23:42:38.374283 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368466 2600 flags.go:64] FLAG: --feature-gates="" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368469 2600 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368472 2600 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368476 2600 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368479 2600 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368482 2600 flags.go:64] FLAG: --healthz-port="10248" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368485 2600 flags.go:64] FLAG: --help="false" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368488 2600 flags.go:64] FLAG: --hostname-override="ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368491 2600 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368494 2600 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368497 2600 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368500 2600 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368503 2600 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368506 2600 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368508 2600 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368511 2600 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368514 2600 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368518 2600 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368521 2600 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368524 2600 flags.go:64] FLAG: --kube-reserved="" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368527 2600 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368529 2600 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368532 2600 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368534 2600 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 23:42:38.374881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368538 2600 flags.go:64] FLAG: --lock-file="" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368540 2600 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368543 2600 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368546 2600 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368551 2600 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368554 2600 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368558 2600 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368560 2600 flags.go:64] FLAG: --logging-format="text" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368563 2600 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368566 2600 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368568 2600 flags.go:64] FLAG: --manifest-url="" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368573 2600 flags.go:64] FLAG: --manifest-url-header="" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368577 2600 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368580 2600 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368584 2600 flags.go:64] FLAG: --max-pods="110" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368587 2600 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368590 2600 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368592 2600 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368595 2600 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368598 2600 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368600 2600 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368603 2600 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368610 2600 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368613 2600 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368616 2600 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 23:42:38.375468 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368620 2600 flags.go:64] FLAG: --pod-cidr="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368623 2600 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368628 2600 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368631 2600 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368634 2600 flags.go:64] FLAG: --pods-per-core="0" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368637 2600 flags.go:64] FLAG: --port="10250" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368639 2600 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368642 2600 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd781b337b3f73a6" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368645 2600 flags.go:64] FLAG: --qos-reserved="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368648 2600 flags.go:64] FLAG: --read-only-port="10255" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368651 2600 flags.go:64] FLAG: --register-node="true" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368654 2600 flags.go:64] FLAG: --register-with-taints="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368657 2600 flags.go:64] FLAG: --registry-burst="10" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368660 2600 flags.go:64] FLAG: --registry-qps="5" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368663 2600 flags.go:64] FLAG: --reserved-cpus="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368666 2600 flags.go:64] FLAG: --reserved-memory="" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368669 2600 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368672 2600 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368676 2600 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368679 2600 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368682 2600 flags.go:64] FLAG: --runonce="false" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368684 2600 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368687 2600 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368690 2600 flags.go:64] FLAG: --seccomp-default="false" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368693 2600 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 23:42:38.376177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368696 2600 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368698 2600 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368701 2600 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368704 2600 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368707 2600 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368710 2600 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368712 2600 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368715 2600 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368719 2600 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368722 2600 flags.go:64] FLAG: --system-cgroups="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368724 2600 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368730 2600 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368732 2600 flags.go:64] FLAG: --tls-cert-file="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368735 2600 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368739 2600 flags.go:64] FLAG: --tls-min-version="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368741 2600 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368744 2600 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368747 2600 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368749 2600 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368752 2600 flags.go:64] FLAG: --v="2" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368756 2600 flags.go:64] FLAG: --version="false" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368761 2600 flags.go:64] FLAG: --vmodule="" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368764 2600 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.368767 2600 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368883 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.376778 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368888 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368891 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368895 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368898 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368901 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368904 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368906 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368909 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368911 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368913 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368916 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368918 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368920 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368923 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368925 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368929 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368932 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368934 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368936 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368940 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.377439 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368943 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368946 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368948 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368950 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368953 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368956 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368958 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368960 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368963 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368966 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368969 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368971 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368974 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368976 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368979 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.368999 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369001 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369004 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369006 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369009 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.377925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369011 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369014 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369016 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369019 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369021 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369023 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369026 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369030 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369032 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369035 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369037 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369040 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369043 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369045 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369048 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369050 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369053 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369055 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369058 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369060 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.378421 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369063 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369066 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369069 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369071 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369074 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369076 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369079 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369081 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369084 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369086 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369089 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369091 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369094 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369096 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369099 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369101 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369103 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369106 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369108 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.378901 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369113 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369117 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369120 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369122 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369126 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369129 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369132 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369134 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369137 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369139 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369142 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369144 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369147 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369149 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369152 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369154 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369158 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369160 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.379371 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.369163 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.369734 2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.376556 2600 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.376573 2600 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.376586 2600 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.376593 2600 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376648 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376653 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376657 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376660 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376663 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376666 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376668 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376671 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376674 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.379803 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376678 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376681 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376685 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376689 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376692 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376695 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376697 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376700 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376703 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376706 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376708 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376710 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376713 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376715 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376718 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376721 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376723 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376725 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376728 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.380248 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376730 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376734 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376737 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376740 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376742 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376745 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376747 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376750 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376752 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376755 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376757 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376759 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376762 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376764 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376766 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376769 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376771 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376775 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376778 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.380700 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376781 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376784 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376787 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376790 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376793 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376797 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376799 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376802 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376804 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376807 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376810 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376813 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376815 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376817 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376821 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376825 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376827 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376830 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376832 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376834 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.381156 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376837 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376839 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376843 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376846 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376849 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376851 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376854 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376856 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376858 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376861 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376863 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376865 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376868 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376870 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376872 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376875 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376877 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376880 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376882 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376885 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.381627 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376887 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376889 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376892 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376894 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376897 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376899 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376902 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376905 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376908 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376911 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376913 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.376915 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.376921 2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377057 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 23:42:38.382122 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377062 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377066 2600 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377069 2600 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377072 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377075 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377078 2600 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377080 2600 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377083 2600 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377085 2600 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377088 2600 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377090 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377093 2600 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377095 2600 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377098 2600 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377102 2600 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377105 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377107 2600 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377110 2600 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377112 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 23:42:38.382481 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377114 2600 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377117 2600 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377119 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377122 2600 feature_gate.go:328] unrecognized feature gate: Example Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377124 2600 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377126 2600 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377129 2600 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377132 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377135 2600 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377137 2600 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377139 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377142 2600 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377144 2600 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377147 2600 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377149 2600 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377151 2600 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377154 2600 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377156 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377158 2600 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377161 2600 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 23:42:38.382940 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377163 2600 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377165 2600 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377168 2600 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377170 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377172 2600 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377175 2600 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377177 2600 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377179 2600 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377182 2600 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377184 2600 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377188 2600 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377191 2600 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377193 2600 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377196 2600 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377199 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377201 2600 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377204 2600 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377206 2600 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377209 2600 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377211 2600 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 23:42:38.383448 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377213 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377217 2600 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377219 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377221 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377224 2600 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377226 2600 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377229 2600 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377232 2600 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377234 2600 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377236 2600 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377238 2600 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377241 2600 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377243 2600 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377245 2600 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377248 2600 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377251 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377253 2600 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377255 2600 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377258 2600 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377260 2600 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 23:42:38.383961 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377263 2600 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377265 2600 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377268 2600 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377270 2600 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377272 2600 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377275 2600 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377277 2600 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377279 2600 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377282 2600 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377284 2600 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377287 2600 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377289 2600 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377291 2600 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377294 2600 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377298 2600 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377301 2600 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377303 2600 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377306 2600 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 23:42:38.384455 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:38.377309 2600 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.377314 2600 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.377423 2600 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.379484 2600 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.381009 2600 server.go:1019] "Starting client certificate rotation" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.381110 2600 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.381151 2600 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.383676 2600 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:42:38.384871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.384834 2600 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 23:42:38.396498 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.396478 2600 log.go:25] "Validated CRI v1 runtime API" Jul 06 23:42:38.400135 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.400120 2600 log.go:25] "Validated CRI v1 image API" Jul 06 23:42:38.401015 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.400995 2600 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 23:42:38.405433 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.405411 2600 fs.go:135] Filesystem UUIDs: map[5fd8220d-21c3-432d-94ac-45e6915f5af5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f83908c1-88b8-480b-ae93-e3b4f1a67c03:/dev/nvme0n1p3] Jul 06 23:42:38.405512 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.405431 2600 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 23:42:38.411095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.410966 2600 manager.go:216] Machine: {Timestamp:2026-07-06 23:42:38.410443143 +0000 UTC m=+0.374271824 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112835 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eab13ad86145be829af1cd0a352fc SystemUUID:ec2eab13-ad86-145b-e829-af1cd0a352fc BootID:1f428695-93bc-47d3-b142-18533a41d892 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:08:07:36:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:08:07:36:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:9d:c1:03:a6:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 23:42:38.411095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.411092 2600 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 23:42:38.411202 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.411172 2600 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 23:42:38.415142 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.415112 2600 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 23:42:38.415345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.415147 2600 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 23:42:38.415972 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.415961 2600 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 23:42:38.416025 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.415977 2600 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 23:42:38.416025 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.415996 2600 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:42:38.416775 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.416762 2600 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 23:42:38.416854 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.416840 2600 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:42:38.418203 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.418191 2600 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 23:42:38.422671 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.422656 2600 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:42:38.422975 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.422964 2600 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 23:42:38.423047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423015 2600 kubelet.go:486] "Attempting to sync node with API server" Jul 06 23:42:38.423047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423033 2600 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 23:42:38.423047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423044 2600 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 23:42:38.423125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423054 2600 kubelet.go:398] "Adding apiserver pod source" Jul 06 23:42:38.423125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423064 2600 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 23:42:38.423421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423403 2600 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:42:38.423421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.423422 2600 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 23:42:38.426417 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.426396 2600 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 23:42:38.428239 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.428223 2600 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 23:42:38.428302 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.428254 2600 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 23:42:38.429377 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429364 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 23:42:38.429415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429384 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 23:42:38.429415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429391 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 23:42:38.429415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429396 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 23:42:38.429415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429405 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 23:42:38.429415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429412 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429422 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429431 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429440 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429446 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429454 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 23:42:38.429549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.429460 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 23:42:38.430271 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.430260 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 23:42:38.430271 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.430271 2600 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 23:42:38.433695 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.433673 2600 server.go:1268] "Started kubelet" Jul 06 23:42:38.433861 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.433810 2600 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 23:42:38.433861 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.433852 2600 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 23:42:38.434017 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.433966 2600 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 23:42:38.434106 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.434078 2600 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 23:42:38.434473 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.434313 2600 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 23:42:38.434473 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.434385 2600 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 23:42:38.434597 ip-10-0-132-64 systemd[1]: Started Kubernetes Kubelet. Jul 06 23:42:38.438648 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.438621 2600 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 23:42:38.440142 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.440121 2600 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nhzd4" Jul 06 23:42:38.440735 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.440715 2600 server.go:310] "Adding debug handlers to kubelet server" Jul 06 23:42:38.441292 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.441264 2600 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 23:42:38.443936 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.442825 2600 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-64.ec2.internal.18bfd7e5907dab0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-64.ec2.internal,UID:ip-10-0-132-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-64.ec2.internal,},FirstTimestamp:2026-07-06 23:42:38.433643276 +0000 UTC m=+0.397472000,LastTimestamp:2026-07-06 23:42:38.433643276 +0000 UTC m=+0.397472000,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-64.ec2.internal,}" Jul 06 23:42:38.445646 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.445628 2600 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nhzd4" Jul 06 23:42:38.446924 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.446904 2600 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 23:42:38.447024 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.446953 2600 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 23:42:38.447137 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.447121 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.447741 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447722 2600 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 23:42:38.447741 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447741 2600 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 23:42:38.447860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447722 2600 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 23:42:38.447860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447823 2600 factory.go:55] Registering systemd factory Jul 06 23:42:38.447860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447832 2600 reconstruct.go:97] "Volume reconstruction finished" Jul 06 23:42:38.447860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447839 2600 factory.go:223] Registration of the systemd container factory successfully Jul 06 23:42:38.448012 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.447841 2600 reconciler.go:29] "Reconciler: start to sync state" Jul 06 23:42:38.448252 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448235 2600 factory.go:153] Registering CRI-O factory Jul 06 23:42:38.448252 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448254 2600 factory.go:223] Registration of the crio container factory successfully Jul 06 23:42:38.448402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448307 2600 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 23:42:38.448402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448331 2600 factory.go:103] Registering Raw factory Jul 06 23:42:38.448402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448346 2600 manager.go:1196] Started watching for new ooms in manager Jul 06 23:42:38.448716 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.448693 2600 manager.go:349] Starting recovery of all containers Jul 06 23:42:38.448834 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.448814 2600 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 23:42:38.448925 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.448904 2600 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 23:42:38.460067 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.459861 2600 manager.go:354] Recovery completed Jul 06 23:42:38.464379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.464367 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.466765 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.466750 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.466816 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.466783 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.466816 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.466797 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.467375 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.467355 2600 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 23:42:38.467375 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.467374 2600 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 23:42:38.467524 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.467382 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.467524 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.467389 2600 state_mem.go:36] "Initialized new in-memory state store" Jul 06 23:42:38.468200 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.468183 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.468264 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.468213 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.468264 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.468224 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.469462 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.469447 2600 policy_none.go:49] "None policy: Start" Jul 06 23:42:38.469538 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.469470 2600 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 23:42:38.469538 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.469481 2600 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 23:42:38.471497 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.471487 2600 policy_none.go:47] "Start" Jul 06 23:42:38.509636 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.509614 2600 manager.go:337] "Starting Device Plugin manager" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.509653 2600 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.509663 2600 server.go:87] "Starting device plugin registration server" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.509895 2600 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.509908 2600 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.510003 2600 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.510077 2600 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.510086 2600 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.510651 2600 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 23:42:38.531923 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.510700 2600 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.551524 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.551486 2600 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 23:42:38.552851 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.552832 2600 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 23:42:38.552935 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.552878 2600 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 23:42:38.552935 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.552908 2600 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 23:42:38.553049 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.552948 2600 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 23:42:38.554870 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.554849 2600 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:42:38.610060 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.610026 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.611263 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.611213 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.611263 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.611243 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.611263 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.611254 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.611415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.611278 2600 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.618914 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.618887 2600 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.618914 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.618914 2600 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-64.ec2.internal\": node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.633045 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.633021 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.653896 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.653871 2600 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"] Jul 06 23:42:38.653959 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.653928 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.655872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.655855 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.655933 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.655885 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.655933 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.655896 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.658181 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.658166 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.658297 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.658280 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.658336 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.658327 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.659275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659258 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.659275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659268 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.659421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659286 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.659421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659287 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.659421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659295 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.659421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.659300 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.661486 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.661472 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.661557 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.661500 2600 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 23:42:38.666033 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.666018 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory" Jul 06 23:42:38.666104 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.666043 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 23:42:38.666104 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.666052 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID" Jul 06 23:42:38.675573 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.675553 2600 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-64.ec2.internal\" not found" node="ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.681525 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.681509 2600 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-64.ec2.internal\" not found" node="ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.733948 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.733920 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.749556 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.749530 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.749651 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.749561 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.749651 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.749580 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40a352da1f355ad260c3fbccfb0e7096-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"40a352da1f355ad260c3fbccfb0e7096\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.835043 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.835001 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.850725 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850702 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40a352da1f355ad260c3fbccfb0e7096-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"40a352da1f355ad260c3fbccfb0e7096\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.850821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850728 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.850821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850744 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.850821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850785 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.850931 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850817 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a7b70da286675732ca28304e44ec4fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"6a7b70da286675732ca28304e44ec4fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.850931 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.850817 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40a352da1f355ad260c3fbccfb0e7096-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"40a352da1f355ad260c3fbccfb0e7096\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.936167 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:38.936083 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:38.979600 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.979575 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:38.985598 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:38.985580 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:39.036483 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.036444 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.137093 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.137046 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.237629 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.237552 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.338157 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.338111 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.380597 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.380567 2600 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 23:42:39.381173 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.380720 2600 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 23:42:39.438834 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.438786 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.455748 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.455708 2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:37:39 +0000 UTC" deadline="2028-01-02 06:12:39.564092822 +0000 UTC" Jul 06 23:42:39.455748 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.455736 2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13062h30m0.108359323s" Jul 06 23:42:39.539513 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.539445 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.585417 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:39.585082 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a352da1f355ad260c3fbccfb0e7096.slice/crio-59b628c82ee5f4628f8e0981ac7022d7323b15a2cea45c352f5dcb722b70a0fa WatchSource:0}: Error finding container 59b628c82ee5f4628f8e0981ac7022d7323b15a2cea45c352f5dcb722b70a0fa: Status 404 returned error can't find the container with id 59b628c82ee5f4628f8e0981ac7022d7323b15a2cea45c352f5dcb722b70a0fa Jul 06 23:42:39.586001 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:39.585956 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7b70da286675732ca28304e44ec4fd.slice/crio-0b8cfa8aac793d2e6abc414c6470338615dce3fa668f59de72f0dbc07811fcd3 WatchSource:0}: Error finding container 0b8cfa8aac793d2e6abc414c6470338615dce3fa668f59de72f0dbc07811fcd3: Status 404 returned error can't find the container with id 0b8cfa8aac793d2e6abc414c6470338615dce3fa668f59de72f0dbc07811fcd3 Jul 06 23:42:39.591462 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.591445 2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:42:39.618895 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.618864 2600 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:42:39.640065 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:39.640032 2600 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found" Jul 06 23:42:39.718106 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.718075 2600 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:42:39.722325 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.722307 2600 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:42:39.747202 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.747185 2600 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" Jul 06 23:42:39.758311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.758291 2600 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:42:39.759622 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.759608 2600 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" Jul 06 23:42:39.768061 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:39.768043 2600 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 23:42:41.586107 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.586068 2600 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 23:42:41.687925 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.687883 2600 apiserver.go:52] "Watching apiserver" Jul 06 23:42:41.697241 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.697216 2600 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 23:42:41.697710 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.697683 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ztc8r","kube-system/global-pull-secret-syncer-jh2wg","kube-system/konnectivity-agent-zsgf2","kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp","openshift-dns/node-resolver-4d9rt","openshift-image-registry/node-ca-wdpw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-kzzq4","openshift-cluster-node-tuning-operator/tuned-zsk9w","openshift-multus/multus-dh5mr","openshift-multus/network-metrics-daemon-b7npf","openshift-network-diagnostics/network-check-target-2kv8z","openshift-network-operator/iptables-alerter-vlb6x"] Jul 06 23:42:41.702237 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.702215 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.704403 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.704138 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:41.704403 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.704208 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:41.704977 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.704936 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.705099 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.704938 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.705099 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.705080 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s62bx\"" Jul 06 23:42:41.706330 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.706311 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.708500 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.708480 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.708906 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.708881 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 23:42:41.709270 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.709042 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 23:42:41.709270 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.709099 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sn7x6\"" Jul 06 23:42:41.710729 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.710710 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.711622 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.711602 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.711815 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.711792 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.712032 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.712015 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 23:42:41.712143 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.712019 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hf4jw\"" Jul 06 23:42:41.712226 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.712209 2600 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 23:42:41.712687 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.712672 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.713112 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.712933 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 23:42:41.713112 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.713005 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.713112 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.713090 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:41.713301 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.713208 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mj6sg\"" Jul 06 23:42:41.713301 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.713299 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.715417 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.715349 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.717691 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.717671 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 23:42:41.718009 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.717986 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.718009 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.718007 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.718175 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.718011 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 23:42:41.718175 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.718036 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8gz6t\"" Jul 06 23:42:41.718175 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.717990 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.718175 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.718095 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 23:42:41.719919 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.719898 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.721136 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.720846 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mm56r\"" Jul 06 23:42:41.721136 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.720945 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.721427 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.721409 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.721627 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.721612 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 23:42:41.722411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.722392 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.722486 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.722805 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vfjdm\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.723479 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.723607 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.725357 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.725547 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.725797 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.725800 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.726073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.725969 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 23:42:41.726694 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726650 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14157aeb-fd0c-469c-a2ea-2da4ead009d0-iptables-alerter-script\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.726781 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726708 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-registration-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726781 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726746 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726781 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726769 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726795 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx2qd\" (UniqueName: \"kubernetes.io/projected/0b48fe1c-6025-4ff8-ae97-02efdab35175-kube-api-access-dx2qd\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726819 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-systemd\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726841 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14157aeb-fd0c-469c-a2ea-2da4ead009d0-host-slash\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726862 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-device-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726892 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-sys-fs\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.726916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726915 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwpph\" (UniqueName: \"kubernetes.io/projected/47249c08-acf0-4137-b84e-0bb997fd9bed-kube-api-access-bwpph\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726938 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-agent-certs\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.726959 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-conf\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727004 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-run\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727026 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-sys\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727087 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-socket-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727127 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727150 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-kubernetes\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727221 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727196 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-tuned\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727234 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-konnectivity-ca\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727272 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-var-lib-kubelet\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727295 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727319 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wck\" (UniqueName: \"kubernetes.io/projected/5c36d839-023b-4f3e-bf97-3087b873d045-kube-api-access-m4wck\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727343 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727365 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-lib-modules\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727386 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-host\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727406 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-tmp\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727430 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mnz\" (UniqueName: \"kubernetes.io/projected/14157aeb-fd0c-469c-a2ea-2da4ead009d0-kube-api-access-f4mnz\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727469 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-modprobe-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.727601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.727491 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysconfig\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.728188 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.728066 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.728360 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.728342 2600 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 23:42:41.728768 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.728750 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-588bl\"" Jul 06 23:42:41.730970 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.730948 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 23:42:41.731389 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.731342 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 23:42:41.732410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.731845 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bljkr\"" Jul 06 23:42:41.732410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.732488 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 23:42:41.752233 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.752211 2600 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rm2pl" Jul 06 23:42:41.759670 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.759646 2600 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rm2pl" Jul 06 23:42:41.812688 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.812601 2600 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 23:42:41.820989 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.820937 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"6a7b70da286675732ca28304e44ec4fd","Type":"ContainerStarted","Data":"0b8cfa8aac793d2e6abc414c6470338615dce3fa668f59de72f0dbc07811fcd3"} Jul 06 23:42:41.822193 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.822167 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" event={"ID":"40a352da1f355ad260c3fbccfb0e7096","Type":"ContainerStarted","Data":"59b628c82ee5f4628f8e0981ac7022d7323b15a2cea45c352f5dcb722b70a0fa"} Jul 06 23:42:41.828509 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828468 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-sys\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828519 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-multus-certs\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828544 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-kubelet\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828567 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-systemd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828584 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-sys\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828591 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-kubernetes\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828612 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cnibin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828633 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-multus\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828655 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-conf-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828676 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-daemon-config\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828700 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwtpn\" (UniqueName: \"kubernetes.io/projected/7449af5b-7c64-4a2f-82f3-4afb148972ba-kube-api-access-wwtpn\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828722 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-host\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828757 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-konnectivity-ca\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828778 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9vxx\" (UniqueName: \"kubernetes.io/projected/54d62a8c-c675-4dba-822a-9187f7dbe6a6-kube-api-access-m9vxx\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828820 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828841 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-ovn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828862 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828881 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.828909 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828904 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-k8s-cni-cncf-io\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828924 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-kubelet\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828946 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mnz\" (UniqueName: \"kubernetes.io/projected/14157aeb-fd0c-469c-a2ea-2da4ead009d0-kube-api-access-f4mnz\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.828986 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysconfig\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829008 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-system-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829028 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsf5q\" (UniqueName: \"kubernetes.io/projected/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-kube-api-access-rsf5q\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829071 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14157aeb-fd0c-469c-a2ea-2da4ead009d0-iptables-alerter-script\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829115 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-registration-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829147 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpjqn\" (UniqueName: \"kubernetes.io/projected/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-kube-api-access-mpjqn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829174 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829199 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829222 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-systemd\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829254 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cni-binary-copy\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829291 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-serviceca\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829315 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-device-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829344 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwpph\" (UniqueName: \"kubernetes.io/projected/47249c08-acf0-4137-b84e-0bb997fd9bed-kube-api-access-bwpph\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829368 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-dbus\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829390 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-etc-kubernetes\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829418 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829442 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-env-overrides\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829466 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b53b6-ff3d-47e8-82a4-73694f2c26e5-tmp-dir\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829489 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2km2\" (UniqueName: \"kubernetes.io/projected/781b53b6-ff3d-47e8-82a4-73694f2c26e5-kube-api-access-b2km2\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829523 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-agent-certs\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829558 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-conf\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829580 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-run\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829608 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-bin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829630 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-os-release\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829653 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829676 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-systemd-units\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829713 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-var-lib-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829754 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-socket-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829781 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829809 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-tuned\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829832 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829856 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-slash\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829878 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829912 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.829955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829936 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/781b53b6-ff3d-47e8-82a4-73694f2c26e5-hosts-file\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829958 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.829965 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-var-lib-kubelet\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830001 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830016 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-var-lib-kubelet\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830031 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-cnibin\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830081 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovn-node-metrics-cert\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830121 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wck\" (UniqueName: \"kubernetes.io/projected/5c36d839-023b-4f3e-bf97-3087b873d045-kube-api-access-m4wck\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830141 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830148 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-lib-modules\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830173 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-host\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830190 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-systemd\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830198 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-tmp\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830223 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-kubelet-config\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830248 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-etc-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830262 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-device-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830273 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-bin\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830297 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-netd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830324 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-modprobe-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830348 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-netns\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830374 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-netns\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830396 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-node-log\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830420 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-log-socket\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830443 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-script-lib\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830471 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx2qd\" (UniqueName: \"kubernetes.io/projected/0b48fe1c-6025-4ff8-ae97-02efdab35175-kube-api-access-dx2qd\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830496 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-os-release\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830525 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-hostroot\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830553 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-system-cni-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830588 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830617 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14157aeb-fd0c-469c-a2ea-2da4ead009d0-host-slash\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830854 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-lib-modules\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.830904 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.830902 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-host\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831103 2600 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831211 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-conf\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831255 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-sys-fs\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831285 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-socket-dir-parent\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831314 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831338 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-config\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.831452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831422 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-run\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.831721 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831455 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14157aeb-fd0c-469c-a2ea-2da4ead009d0-host-slash\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.831721 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831541 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-kubernetes\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.831721 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.831645 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-socket-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.831721 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.831718 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:41.831850 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.831773 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:42.331754613 +0000 UTC m=+3.032515427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:41.832592 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.832570 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14157aeb-fd0c-469c-a2ea-2da4ead009d0-iptables-alerter-script\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.832716 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.832615 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-konnectivity-ca\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.832813 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.832798 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysconfig\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.832878 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.832866 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-modprobe-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.833332 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.833003 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-sys-fs\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.833332 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.833241 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b48fe1c-6025-4ff8-ae97-02efdab35175-registration-dir\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.833474 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.833332 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-sysctl-d\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.834739 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.834721 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-tmp\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.835021 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.835000 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/37c8c3b0-eb91-4ae7-97a0-a85eef1d7527-agent-certs\") pod \"konnectivity-agent-zsgf2\" (UID: \"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527\") " pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:41.838499 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.838471 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwpph\" (UniqueName: \"kubernetes.io/projected/47249c08-acf0-4137-b84e-0bb997fd9bed-kube-api-access-bwpph\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.838630 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.838597 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47249c08-acf0-4137-b84e-0bb997fd9bed-etc-tuned\") pod \"tuned-zsk9w\" (UID: \"47249c08-acf0-4137-b84e-0bb997fd9bed\") " pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:41.841133 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.841114 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:41.841133 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.841136 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:41.841266 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.841151 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:41.841266 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.841233 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:42.341213186 +0000 UTC m=+3.041974002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:41.843499 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.843480 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wck\" (UniqueName: \"kubernetes.io/projected/5c36d839-023b-4f3e-bf97-3087b873d045-kube-api-access-m4wck\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:41.843692 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.843668 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mnz\" (UniqueName: \"kubernetes.io/projected/14157aeb-fd0c-469c-a2ea-2da4ead009d0-kube-api-access-f4mnz\") pod \"iptables-alerter-vlb6x\" (UID: \"14157aeb-fd0c-469c-a2ea-2da4ead009d0\") " pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:41.843692 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.843685 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx2qd\" (UniqueName: \"kubernetes.io/projected/0b48fe1c-6025-4ff8-ae97-02efdab35175-kube-api-access-dx2qd\") pod \"aws-ebs-csi-driver-node-rvwdp\" (UID: \"0b48fe1c-6025-4ff8-ae97-02efdab35175\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:41.932530 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932491 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cni-binary-copy\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.932530 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932538 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-serviceca\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932566 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-dbus\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932583 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-etc-kubernetes\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932601 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932619 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-env-overrides\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932642 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b53b6-ff3d-47e8-82a4-73694f2c26e5-tmp-dir\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932666 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2km2\" (UniqueName: \"kubernetes.io/projected/781b53b6-ff3d-47e8-82a4-73694f2c26e5-kube-api-access-b2km2\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932683 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-bin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932698 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-os-release\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932711 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932727 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-systemd-units\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.932770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932749 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-var-lib-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932781 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932795 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-slash\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932810 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932825 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932841 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/781b53b6-ff3d-47e8-82a4-73694f2c26e5-hosts-file\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932863 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-cnibin\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932878 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovn-node-metrics-cert\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932896 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-kubelet-config\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932924 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-etc-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932946 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-bin\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932964 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-netd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.932979 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-netns\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933001 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-netns\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933015 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-node-log\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933028 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-log-socket\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933043 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-script-lib\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933075 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-os-release\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933089 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-hostroot\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933104 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-system-cni-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933118 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933135 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-socket-dir-parent\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933152 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933177 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-config\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933196 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-multus-certs\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933210 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-kubelet\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933224 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-systemd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933240 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cnibin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933255 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-multus\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933271 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-conf-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933285 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-daemon-config\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933303 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwtpn\" (UniqueName: \"kubernetes.io/projected/7449af5b-7c64-4a2f-82f3-4afb148972ba-kube-api-access-wwtpn\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933317 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-host\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933334 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9vxx\" (UniqueName: \"kubernetes.io/projected/54d62a8c-c675-4dba-822a-9187f7dbe6a6-kube-api-access-m9vxx\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.933835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933349 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933369 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-ovn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933399 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933414 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-k8s-cni-cncf-io\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933429 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-kubelet\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933447 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-system-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933461 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsf5q\" (UniqueName: \"kubernetes.io/projected/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-kube-api-access-rsf5q\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.933479 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpjqn\" (UniqueName: \"kubernetes.io/projected/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-kube-api-access-mpjqn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.934343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934155 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cni-binary-copy\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.934567 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934436 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-serviceca\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.934567 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934553 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-dbus\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.934625 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934593 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-etc-kubernetes\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934721 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-multus\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934772 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934809 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-ovn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934820 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934816 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-conf-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934849 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-host\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934870 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-os-release\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934881 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934774 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-k8s-cni-cncf-io\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934953 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-hostroot\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.934973 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935026 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-netd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935027 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-cnibin\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935099 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-etc-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935107 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935126 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-kubelet\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935192 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-netns\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935262 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935304 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-systemd-units\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935195 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-os-release\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935352 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-var-lib-openvswitch\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935382 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-daemon-config\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935391 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-node-log\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935403 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-env-overrides\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935423 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-slash\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935424 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7449af5b-7c64-4a2f-82f3-4afb148972ba-system-cni-dir\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935449 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-system-cni-dir\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935459 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-netns\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935461 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-log-socket\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935477 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-multus-socket-dir-parent\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935502 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b522481-71e4-4b14-9212-e483310aa5c2-kubelet-config\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935499 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b53b6-ff3d-47e8-82a4-73694f2c26e5-tmp-dir\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.935923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935509 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/781b53b6-ff3d-47e8-82a4-73694f2c26e5-hosts-file\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935528 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-run-systemd\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935534 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-cni-bin\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935541 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-host-kubelet\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935582 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-var-lib-cni-bin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935594 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-cnibin\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935613 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935538 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7449af5b-7c64-4a2f-82f3-4afb148972ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.935646 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935680 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d62a8c-c675-4dba-822a-9187f7dbe6a6-host-run-multus-certs\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:41.935713 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:42.435695207 +0000 UTC m=+3.136456009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935894 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-config\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.936683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.935986 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovnkube-script-lib\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.938639 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.938617 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-ovn-node-metrics-cert\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.944629 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.944580 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsf5q\" (UniqueName: \"kubernetes.io/projected/466fd84d-3b4c-416b-9946-a2aa2c2e1a4f-kube-api-access-rsf5q\") pod \"node-ca-wdpw4\" (UID: \"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f\") " pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:41.944629 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.944594 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwtpn\" (UniqueName: \"kubernetes.io/projected/7449af5b-7c64-4a2f-82f3-4afb148972ba-kube-api-access-wwtpn\") pod \"multus-additional-cni-plugins-kzzq4\" (UID: \"7449af5b-7c64-4a2f-82f3-4afb148972ba\") " pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:41.944836 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.944813 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2km2\" (UniqueName: \"kubernetes.io/projected/781b53b6-ff3d-47e8-82a4-73694f2c26e5-kube-api-access-b2km2\") pod \"node-resolver-4d9rt\" (UID: \"781b53b6-ff3d-47e8-82a4-73694f2c26e5\") " pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:41.945251 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.945235 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpjqn\" (UniqueName: \"kubernetes.io/projected/29f58a2e-fd43-4d97-a226-55ba0ba4c2d8-kube-api-access-mpjqn\") pod \"ovnkube-node-ztc8r\" (UID: \"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:41.945549 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:41.945528 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9vxx\" (UniqueName: \"kubernetes.io/projected/54d62a8c-c675-4dba-822a-9187f7dbe6a6-kube-api-access-m9vxx\") pod \"multus-dh5mr\" (UID: \"54d62a8c-c675-4dba-822a-9187f7dbe6a6\") " pod="openshift-multus/multus-dh5mr" Jul 06 23:42:42.014666 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.014623 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" Jul 06 23:42:42.022619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.022596 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:42:42.034475 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.034448 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vlb6x" Jul 06 23:42:42.041193 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.041162 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" Jul 06 23:42:42.047866 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.047846 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" Jul 06 23:42:42.055533 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.055510 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wdpw4" Jul 06 23:42:42.062281 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.062256 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:42:42.068890 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.068867 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dh5mr" Jul 06 23:42:42.074418 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.074397 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4d9rt" Jul 06 23:42:42.336863 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.336781 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:42.337023 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.336938 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:42.337023 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.337010 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:43.336993811 +0000 UTC m=+4.037754612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:42.437977 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.437945 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:42.437977 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.437984 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:42.438187 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438118 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:42.438187 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438125 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:42.438187 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438135 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:42.438187 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438147 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:42.438304 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438189 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:43.43817534 +0000 UTC m=+4.138936139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:42.438304 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.438204 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:43.438197996 +0000 UTC m=+4.138958794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:42.763992 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.763911 2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:37:41 +0000 UTC" deadline="2028-04-06 06:40:17.561691884 +0000 UTC" Jul 06 23:42:42.763992 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.763946 2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15342h57m34.797748443s" Jul 06 23:42:42.816164 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:42.816145 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:42.816266 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:42.816246 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:42.828521 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.828368 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7449af5b_7c64_4a2f_82f3_4afb148972ba.slice/crio-c077e429d7daf9bb7a8cb989c1b09861422d8a64df61b5eb3f4cad94871a2ff5 WatchSource:0}: Error finding container c077e429d7daf9bb7a8cb989c1b09861422d8a64df61b5eb3f4cad94871a2ff5: Status 404 returned error can't find the container with id c077e429d7daf9bb7a8cb989c1b09861422d8a64df61b5eb3f4cad94871a2ff5 Jul 06 23:42:42.835381 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.835353 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466fd84d_3b4c_416b_9946_a2aa2c2e1a4f.slice/crio-02ec039fbd47dad1d0cebfbfcba70c4693ce2cc85493d7de4af190a8942a700e WatchSource:0}: Error finding container 02ec039fbd47dad1d0cebfbfcba70c4693ce2cc85493d7de4af190a8942a700e: Status 404 returned error can't find the container with id 02ec039fbd47dad1d0cebfbfcba70c4693ce2cc85493d7de4af190a8942a700e Jul 06 23:42:42.839261 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.839217 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781b53b6_ff3d_47e8_82a4_73694f2c26e5.slice/crio-7b9eeeda5af84a167d7b7c0bce0b146bb44a32384d8294096bbcb462ab43fa40 WatchSource:0}: Error finding container 7b9eeeda5af84a167d7b7c0bce0b146bb44a32384d8294096bbcb462ab43fa40: Status 404 returned error can't find the container with id 7b9eeeda5af84a167d7b7c0bce0b146bb44a32384d8294096bbcb462ab43fa40 Jul 06 23:42:42.841121 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.841107 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f58a2e_fd43_4d97_a226_55ba0ba4c2d8.slice/crio-d9b6dec2e76c863fbbfc6d6882d098ed94e3b4e206f6f005d71d834d489cb6c6 WatchSource:0}: Error finding container d9b6dec2e76c863fbbfc6d6882d098ed94e3b4e206f6f005d71d834d489cb6c6: Status 404 returned error can't find the container with id d9b6dec2e76c863fbbfc6d6882d098ed94e3b4e206f6f005d71d834d489cb6c6 Jul 06 23:42:42.841953 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.841930 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c8c3b0_eb91_4ae7_97a0_a85eef1d7527.slice/crio-3f31fa008f814a6781b43a88578c843eab643d61f00f2152ff433548a196ece5 WatchSource:0}: Error finding container 3f31fa008f814a6781b43a88578c843eab643d61f00f2152ff433548a196ece5: Status 404 returned error can't find the container with id 3f31fa008f814a6781b43a88578c843eab643d61f00f2152ff433548a196ece5 Jul 06 23:42:42.843312 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.843293 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d62a8c_c675_4dba_822a_9187f7dbe6a6.slice/crio-1d2859ba1df3cd5bcfac3e64b0597bd129f86b0fbb657cc497479531cce18a33 WatchSource:0}: Error finding container 1d2859ba1df3cd5bcfac3e64b0597bd129f86b0fbb657cc497479531cce18a33: Status 404 returned error can't find the container with id 1d2859ba1df3cd5bcfac3e64b0597bd129f86b0fbb657cc497479531cce18a33 Jul 06 23:42:42.847536 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.846319 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b48fe1c_6025_4ff8_ae97_02efdab35175.slice/crio-591986412ca31368727f0e3957eab820cc4d052d38ea8907bdab20a2d8035aee WatchSource:0}: Error finding container 591986412ca31368727f0e3957eab820cc4d052d38ea8907bdab20a2d8035aee: Status 404 returned error can't find the container with id 591986412ca31368727f0e3957eab820cc4d052d38ea8907bdab20a2d8035aee Jul 06 23:42:42.847536 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.846968 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14157aeb_fd0c_469c_a2ea_2da4ead009d0.slice/crio-c2b7e950ff0fb5c815b185ebb54d1e90175e7d3aa259a02233c1117f36915e77 WatchSource:0}: Error finding container c2b7e950ff0fb5c815b185ebb54d1e90175e7d3aa259a02233c1117f36915e77: Status 404 returned error can't find the container with id c2b7e950ff0fb5c815b185ebb54d1e90175e7d3aa259a02233c1117f36915e77 Jul 06 23:42:42.849437 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:42:42.849393 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47249c08_acf0_4137_b84e_0bb997fd9bed.slice/crio-5ba43eac5a711c5221fb1ee9e3652c6c06498e0e04115454f75030744bc07d90 WatchSource:0}: Error finding container 5ba43eac5a711c5221fb1ee9e3652c6c06498e0e04115454f75030744bc07d90: Status 404 returned error can't find the container with id 5ba43eac5a711c5221fb1ee9e3652c6c06498e0e04115454f75030744bc07d90 Jul 06 23:42:43.344047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.343953 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:43.344215 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.344181 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:43.344271 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.344259 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:45.344240639 +0000 UTC m=+6.045001441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:43.444857 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.444815 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:43.445042 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.444873 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:43.445145 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445039 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:43.445145 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445079 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:43.445145 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445093 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:43.445292 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445155 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:45.445135913 +0000 UTC m=+6.145896725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:43.445606 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445585 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:43.445682 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.445644 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:45.445628925 +0000 UTC m=+6.146389737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:43.765158 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.765088 2600 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:37:41 +0000 UTC" deadline="2028-01-19 21:30:34.225999881 +0000 UTC" Jul 06 23:42:43.765158 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.765155 2600 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13485h47m50.460848966s" Jul 06 23:42:43.829270 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.829144 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:43.829447 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.829279 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:43.829737 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.829683 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:43.829807 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:43.829771 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:43.837751 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.837714 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" event={"ID":"40a352da1f355ad260c3fbccfb0e7096","Type":"ContainerStarted","Data":"349d38ba49c7717fed86689fbbd9020cb30d83e8844970ab6c23fdc198af6dc6"} Jul 06 23:42:43.847807 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.847689 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" event={"ID":"0b48fe1c-6025-4ff8-ae97-02efdab35175","Type":"ContainerStarted","Data":"591986412ca31368727f0e3957eab820cc4d052d38ea8907bdab20a2d8035aee"} Jul 06 23:42:43.860398 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.859253 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" podStartSLOduration=2.8592299260000003 podStartE2EDuration="2.859229926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:43.858746322 +0000 UTC m=+4.559507143" watchObservedRunningTime="2026-07-06 23:42:43.859229926 +0000 UTC m=+4.559990747" Jul 06 23:42:43.860398 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.860259 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4d9rt" event={"ID":"781b53b6-ff3d-47e8-82a4-73694f2c26e5","Type":"ContainerStarted","Data":"7b9eeeda5af84a167d7b7c0bce0b146bb44a32384d8294096bbcb462ab43fa40"} Jul 06 23:42:43.869515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.869433 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dh5mr" event={"ID":"54d62a8c-c675-4dba-822a-9187f7dbe6a6","Type":"ContainerStarted","Data":"1d2859ba1df3cd5bcfac3e64b0597bd129f86b0fbb657cc497479531cce18a33"} Jul 06 23:42:43.871407 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.871288 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"d9b6dec2e76c863fbbfc6d6882d098ed94e3b4e206f6f005d71d834d489cb6c6"} Jul 06 23:42:43.872802 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.872714 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerStarted","Data":"c077e429d7daf9bb7a8cb989c1b09861422d8a64df61b5eb3f4cad94871a2ff5"} Jul 06 23:42:43.875648 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.874826 2600 generic.go:356] "Generic (PLEG): container finished" podID="6a7b70da286675732ca28304e44ec4fd" containerID="c607745c6a54622b82a7bf631fd0efb0f8cbf1599877893123f804c90a2e91f1" exitCode=0 Jul 06 23:42:43.875648 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.874900 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"6a7b70da286675732ca28304e44ec4fd","Type":"ContainerDied","Data":"c607745c6a54622b82a7bf631fd0efb0f8cbf1599877893123f804c90a2e91f1"} Jul 06 23:42:43.879804 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.878212 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsgf2" event={"ID":"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527","Type":"ContainerStarted","Data":"3f31fa008f814a6781b43a88578c843eab643d61f00f2152ff433548a196ece5"} Jul 06 23:42:43.883652 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.883612 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" event={"ID":"47249c08-acf0-4137-b84e-0bb997fd9bed","Type":"ContainerStarted","Data":"5ba43eac5a711c5221fb1ee9e3652c6c06498e0e04115454f75030744bc07d90"} Jul 06 23:42:43.906042 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.906001 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vlb6x" event={"ID":"14157aeb-fd0c-469c-a2ea-2da4ead009d0","Type":"ContainerStarted","Data":"c2b7e950ff0fb5c815b185ebb54d1e90175e7d3aa259a02233c1117f36915e77"} Jul 06 23:42:43.913044 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:43.913010 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdpw4" event={"ID":"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f","Type":"ContainerStarted","Data":"02ec039fbd47dad1d0cebfbfcba70c4693ce2cc85493d7de4af190a8942a700e"} Jul 06 23:42:44.817385 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:44.816911 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:44.817385 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:44.817035 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:44.931114 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:44.931080 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"6a7b70da286675732ca28304e44ec4fd","Type":"ContainerStarted","Data":"7cbd07586d6e9413970dc5463f655eac36e4c62b6943ee2bc452b2d733c600d6"} Jul 06 23:42:45.371527 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:45.371489 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:45.371723 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.371706 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:45.371783 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.371773 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:49.371753096 +0000 UTC m=+10.072513896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:45.472448 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:45.472409 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:45.472639 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:45.472461 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:45.472639 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.472589 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:45.472639 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.472605 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:45.472639 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.472617 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:45.472831 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.472675 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:49.472657906 +0000 UTC m=+10.173418705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:45.473113 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.473091 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:45.473202 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.473148 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:49.473131692 +0000 UTC m=+10.173892490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:45.822569 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:45.822484 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:45.823013 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.822626 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:45.823013 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:45.822693 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:45.823013 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:45.822780 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:46.817090 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:46.817044 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:46.819192 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:46.819142 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:47.817386 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:47.817350 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:47.817770 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:47.817499 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:47.817770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:47.817696 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:47.817770 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:47.817745 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:48.816910 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:48.816878 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:48.817099 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:48.816995 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:49.411916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:49.411834 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:49.412403 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.412013 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:49.412403 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.412112 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.412089854 +0000 UTC m=+18.112850658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:49.512685 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:49.512652 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:49.512872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:49.512699 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:49.512872 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.512840 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:49.512963 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.512922 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.512902633 +0000 UTC m=+18.213663447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:49.512963 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.512845 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:49.513068 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.512969 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:49.513068 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.512979 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:49.513068 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.513023 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.513012236 +0000 UTC m=+18.213773034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:49.817377 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:49.817338 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:49.817591 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.817453 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:49.817591 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:49.817509 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:49.817665 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:49.817588 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:50.817024 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:50.816308 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:50.817024 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:50.816439 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:51.817357 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:51.816350 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:51.817357 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:51.816367 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:51.817357 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:51.816484 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:51.817357 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:51.817221 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:52.816937 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:52.816902 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:52.817142 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:52.817009 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:53.817197 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:53.817158 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:53.817651 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:53.817170 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:53.817651 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:53.817302 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:53.817651 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:53.817328 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:54.816430 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:54.816393 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:54.816596 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:54.816522 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:55.816851 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:55.816811 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:55.817340 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:55.816957 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:55.817340 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:55.817018 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:55.817340 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:55.817156 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:56.816179 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:56.816143 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:56.816389 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:56.816256 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:57.475149 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:57.475108 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:57.475740 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.475261 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:57.475740 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.475325 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:13.475308822 +0000 UTC m=+34.176069624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:42:57.576308 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:57.576266 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:57.576489 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:57.576319 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:57.576489 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576424 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:57.576586 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576504 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:13.576485226 +0000 UTC m=+34.277246026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:42:57.576586 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576430 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:42:57.576586 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576544 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:42:57.576586 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576559 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:57.576769 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.576605 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:13.576594153 +0000 UTC m=+34.277354975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:42:57.816655 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:57.816619 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:57.816825 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.816738 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:57.816825 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:57.816805 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:57.816946 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:57.816923 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:42:58.816953 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:58.816918 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:42:58.817377 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:58.817038 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:42:59.817658 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:59.817618 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:42:59.818131 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:59.817734 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:42:59.818131 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:42:59.817816 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:42:59.818131 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:42:59.817934 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:00.816798 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:00.816752 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:00.816977 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:00.816899 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:01.816447 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:01.816406 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:01.816892 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:01.816406 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:01.816892 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:01.816572 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:01.816892 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:01.816639 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:02.816888 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.816579 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:02.817777 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:02.816959 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:02.970742 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.970651 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4d9rt" event={"ID":"781b53b6-ff3d-47e8-82a4-73694f2c26e5","Type":"ContainerStarted","Data":"ebd66298ae10cc4256a4f4ddb3a96d2c530d9fcb1ed6bf691bf62824adbc3c6c"} Jul 06 23:43:02.972539 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.972510 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dh5mr" event={"ID":"54d62a8c-c675-4dba-822a-9187f7dbe6a6","Type":"ContainerStarted","Data":"539a769b1ea787fb24d5b311dba6c30126dabd30965aad5f917ae75b5076ec91"} Jul 06 23:43:02.976071 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.975999 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"1113dd14d47bb3ff45b01ac10fe0b5551d1e5660f59de370c60a86c903e646cf"} Jul 06 23:43:02.976215 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.976110 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"5abd17901dbdf40c80b7c78498a7bd81ff8553b3e38b89b4655c687c8feb1588"} Jul 06 23:43:02.976215 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.976149 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"f8514cd3667d504417bac6037341d0f1c56c40d481b4ba6057718debccf3eaca"} Jul 06 23:43:02.976215 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.976186 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"2cce3cfe602f3761f1f35debeefd823b620c443c8da8b0036c8d2d1b7463e04c"} Jul 06 23:43:02.976215 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.976214 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"714425328a96a142fb87d9f44cf8474c715260220474228be57f973a815a6b87"} Jul 06 23:43:02.976424 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.976250 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"b993738d9b7b819ed2995adf330052d74879c4c708bac3b1e7c1a7ba8f142a59"} Jul 06 23:43:02.977957 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.977925 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="3d3f59fed3af081557c501d7f857d7201c211e54d55f944ae889517b77d43af7" exitCode=0 Jul 06 23:43:02.978095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.978015 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"3d3f59fed3af081557c501d7f857d7201c211e54d55f944ae889517b77d43af7"} Jul 06 23:43:02.980200 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.980174 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsgf2" event={"ID":"37c8c3b0-eb91-4ae7-97a0-a85eef1d7527","Type":"ContainerStarted","Data":"7315df3a5be6d14b515b733f060ff1920783a497f165dc1654158b31b9dce0a5"} Jul 06 23:43:02.982540 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.982515 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" event={"ID":"47249c08-acf0-4137-b84e-0bb997fd9bed","Type":"ContainerStarted","Data":"000f95cda18f288e6502c43dcfebb21e03a25127e7347b3cb3fb6cd83d89b126"} Jul 06 23:43:02.985530 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.985506 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wdpw4" event={"ID":"466fd84d-3b4c-416b-9946-a2aa2c2e1a4f","Type":"ContainerStarted","Data":"4b7dd287d48766be738a93197da88ca9ade3e9ac344401f6659a53adf2ebbe2f"} Jul 06 23:43:02.987153 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.987132 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" event={"ID":"0b48fe1c-6025-4ff8-ae97-02efdab35175","Type":"ContainerStarted","Data":"46fcd48bb89e57ba6407d54b3709747f8adb5bdc970a65b90f823a229882417a"} Jul 06 23:43:02.987257 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.987200 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" podStartSLOduration=21.98718756 podStartE2EDuration="21.98718756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:44.952173137 +0000 UTC m=+5.652933972" watchObservedRunningTime="2026-07-06 23:43:02.98718756 +0000 UTC m=+23.687948358" Jul 06 23:43:02.987769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:02.987744 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4d9rt" podStartSLOduration=3.7638368719999997 podStartE2EDuration="22.987738396s" totalImagesPullingTime="19.223901524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:02.987234704 +0000 UTC m=+23.687995525" watchObservedRunningTime="2026-07-06 23:43:02.987738396 +0000 UTC m=+23.688499216" Jul 06 23:43:03.005188 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.005132 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dh5mr" podStartSLOduration=3.723750031 podStartE2EDuration="23.005115022s" totalImagesPullingTime="19.281364991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:03.004711639 +0000 UTC m=+23.705472486" watchObservedRunningTime="2026-07-06 23:43:03.005115022 +0000 UTC m=+23.705875842" Jul 06 23:43:03.022958 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.022909 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zsk9w" podStartSLOduration=4.809575807 podStartE2EDuration="24.022894927s" totalImagesPullingTime="19.21331912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:03.0226774 +0000 UTC m=+23.723438233" watchObservedRunningTime="2026-07-06 23:43:03.022894927 +0000 UTC m=+23.723655746" Jul 06 23:43:03.066369 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.066309 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wdpw4" podStartSLOduration=4.840125434 podStartE2EDuration="24.066286441s" totalImagesPullingTime="19.226161007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:03.066219391 +0000 UTC m=+23.766980229" watchObservedRunningTime="2026-07-06 23:43:03.066286441 +0000 UTC m=+23.767047261" Jul 06 23:43:03.081817 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.081766 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zsgf2" podStartSLOduration=12.870555337999999 podStartE2EDuration="24.081749967s" totalImagesPullingTime="11.211194629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:03.081233661 +0000 UTC m=+23.781994481" watchObservedRunningTime="2026-07-06 23:43:03.081749967 +0000 UTC m=+23.782510787" Jul 06 23:43:03.534404 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.534376 2600 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 23:43:03.786220 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.786122 2600 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:43:03.534396857Z","UUID":"95ec5ef6-f8fe-42a6-b9db-a9ca37b183d4","Handler":null,"Name":"","Endpoint":""} Jul 06 23:43:03.787854 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.787835 2600 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 23:43:03.787983 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.787870 2600 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 23:43:03.816316 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.816277 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:03.816492 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:03.816457 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:03.816877 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.816290 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:03.817013 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:03.816992 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:03.990888 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.990853 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vlb6x" event={"ID":"14157aeb-fd0c-469c-a2ea-2da4ead009d0","Type":"ContainerStarted","Data":"dadc2ec7795076783984d0e043c84e71197b933a0a52046914278d9120be30ad"} Jul 06 23:43:03.992821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:03.992794 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" event={"ID":"0b48fe1c-6025-4ff8-ae97-02efdab35175","Type":"ContainerStarted","Data":"5bb52594d2b2f9711650b1da1107c610754425f7da619b0798caa1c695c9662b"} Jul 06 23:43:04.005416 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:04.005363 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vlb6x" podStartSLOduration=5.78975508 podStartE2EDuration="25.005346953s" totalImagesPullingTime="19.215591873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:04.004837254 +0000 UTC m=+24.705598085" watchObservedRunningTime="2026-07-06 23:43:04.005346953 +0000 UTC m=+24.706107773" Jul 06 23:43:04.816525 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:04.816345 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:04.816676 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:04.816641 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:04.997925 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:04.997854 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" event={"ID":"0b48fe1c-6025-4ff8-ae97-02efdab35175","Type":"ContainerStarted","Data":"f2ed4f0ac321dfc80bcfa002735d4ff8e82dd85fb00cbe04da68051302d84ee0"} Jul 06 23:43:05.002465 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:05.002432 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"7215940e5244a9faa90898481986d8791bb026959ae497a388ce5bad7a57b5f2"} Jul 06 23:43:05.016678 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:05.016627 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvwdp" podStartSLOduration=4.605592286 podStartE2EDuration="26.016611598s" totalImagesPullingTime="21.411019312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:05.016462782 +0000 UTC m=+25.717223627" watchObservedRunningTime="2026-07-06 23:43:05.016611598 +0000 UTC m=+25.717372418" Jul 06 23:43:05.816657 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:05.816624 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:05.816657 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:05.816668 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:05.816940 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:05.816792 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:05.816940 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:05.816880 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:06.817070 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:06.817020 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:06.817570 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:06.817154 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:07.373548 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:07.373502 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:43:07.374456 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:07.374429 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:43:07.495121 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:07.495090 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4d9rt_781b53b6-ff3d-47e8-82a4-73694f2c26e5/dns-node-resolver/0.log" Jul 06 23:43:07.817005 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:07.816969 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:07.817212 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:07.817113 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:07.817212 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:07.817178 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:07.817707 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:07.817303 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:08.010473 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:08.010432 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:43:08.010955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:08.010935 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zsgf2" Jul 06 23:43:08.816708 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:08.816530 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:08.816883 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:08.816777 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:08.878085 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:08.878047 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdpw4_466fd84d-3b4c-416b-9946-a2aa2c2e1a4f/node-ca/0.log" Jul 06 23:43:09.015303 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.015270 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" event={"ID":"29f58a2e-fd43-4d97-a226-55ba0ba4c2d8","Type":"ContainerStarted","Data":"325f92a8ba7799da1f15d96c6c93a1fb0481a4e5c4220aa8348ac2df844668c6"} Jul 06 23:43:09.015821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.015625 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:09.017144 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.017121 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="a3ff82a078db3cf6614849799497cd55ce65215843bc0fbdea2782e03301d991" exitCode=0 Jul 06 23:43:09.017218 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.017179 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"a3ff82a078db3cf6614849799497cd55ce65215843bc0fbdea2782e03301d991"} Jul 06 23:43:09.032348 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.032326 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:09.046197 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.046152 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" podStartSLOduration=10.757859171 podStartE2EDuration="30.046136667s" totalImagesPullingTime="19.288277496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:09.045695708 +0000 UTC m=+29.746456527" watchObservedRunningTime="2026-07-06 23:43:09.046136667 +0000 UTC m=+29.746897485" Jul 06 23:43:09.818265 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.818229 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:09.818491 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:09.818349 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:09.818491 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:09.818397 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:09.818619 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:09.818518 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:10.019770 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.019742 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:10.020293 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.020272 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:10.036332 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.035923 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:10.417427 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.417179 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh2wg"] Jul 06 23:43:10.417624 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.417460 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:10.417624 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:10.417548 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:10.420014 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.419987 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7npf"] Jul 06 23:43:10.420177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.420097 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:10.420243 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:10.420184 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:10.420667 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.420646 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2kv8z"] Jul 06 23:43:10.420774 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:10.420728 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:10.420835 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:10.420812 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:11.024622 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:11.024595 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="784003f23e882d4aa32016f2a08296e27a7c0b3e3d688be2d2f0242451a84cde" exitCode=0 Jul 06 23:43:11.025105 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:11.024675 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"784003f23e882d4aa32016f2a08296e27a7c0b3e3d688be2d2f0242451a84cde"} Jul 06 23:43:11.816457 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:11.816419 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:11.816662 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:11.816419 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:11.816662 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:11.816562 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:11.816662 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:11.816419 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:11.816662 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:11.816632 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:11.816846 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:11.816738 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:13.031071 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.031023 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="cb4ea1a51bb09b57542141934c5a3eb21ff3bfc7ebf0e64475d1bae834b2d87f" exitCode=0 Jul 06 23:43:13.031592 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.031082 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"cb4ea1a51bb09b57542141934c5a3eb21ff3bfc7ebf0e64475d1bae834b2d87f"} Jul 06 23:43:13.492793 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.492756 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:13.492958 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.492897 2600 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:13.492999 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.492971 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs podName:5c36d839-023b-4f3e-bf97-3087b873d045 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:45.492955359 +0000 UTC m=+66.193716158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs") pod "network-metrics-daemon-b7npf" (UID: "5c36d839-023b-4f3e-bf97-3087b873d045") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 23:43:13.593399 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.593367 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.593413 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593485 2600 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593516 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593532 2600 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593543 2600 projected.go:196] Error preparing data for projected volume kube-api-access-lz2vj for pod openshift-network-diagnostics/network-check-target-2kv8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:13.593562 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593559 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret podName:2b522481-71e4-4b14-9212-e483310aa5c2 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:45.593539432 +0000 UTC m=+66.294300230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret") pod "global-pull-secret-syncer-jh2wg" (UID: "2b522481-71e4-4b14-9212-e483310aa5c2") : object "kube-system"/"original-pull-secret" not registered Jul 06 23:43:13.593922 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.593591 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj podName:d278ac22-c4f7-44f3-aa11-7cead2913c95 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:45.593576619 +0000 UTC m=+66.294337417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz2vj" (UniqueName: "kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj") pod "network-check-target-2kv8z" (UID: "d278ac22-c4f7-44f3-aa11-7cead2913c95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 23:43:13.816619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.816535 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:13.816758 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.816543 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:13.816758 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.816635 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:13.816758 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:13.816644 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:13.816871 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.816756 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:13.816871 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:13.816851 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:15.816818 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:15.816789 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:15.817312 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:15.816789 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:15.817312 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:15.816903 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:15.817312 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:15.816961 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:15.817312 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:15.816789 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:15.817312 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:15.817027 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:17.816767 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:17.816740 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:17.816767 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:17.816759 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:17.817192 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:17.816852 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:17.817192 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:17.816943 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:17.817192 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:17.816996 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:17.817192 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:17.817087 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:18.045749 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:18.045663 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="38972fa9147a41eb3c5188c497b19f540ce70418081d7b39f904a3de69d728b6" exitCode=0 Jul 06 23:43:18.045749 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:18.045715 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"38972fa9147a41eb3c5188c497b19f540ce70418081d7b39f904a3de69d728b6"} Jul 06 23:43:19.050609 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:19.050576 2600 generic.go:356] "Generic (PLEG): container finished" podID="7449af5b-7c64-4a2f-82f3-4afb148972ba" containerID="d83e3d60799949b6646a016d3fd4c32be6827475e5a1bd5aad19affafe9c928d" exitCode=0 Jul 06 23:43:19.050963 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:19.050632 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerDied","Data":"d83e3d60799949b6646a016d3fd4c32be6827475e5a1bd5aad19affafe9c928d"} Jul 06 23:43:19.819937 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:19.819754 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:19.820120 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:19.819835 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:19.820120 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:19.819859 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:19.820213 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:19.820119 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:19.820213 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:19.819998 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:19.820213 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:19.820188 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:20.056548 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:20.056511 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" event={"ID":"7449af5b-7c64-4a2f-82f3-4afb148972ba","Type":"ContainerStarted","Data":"1996e2f80313fe7a251fd3715b058cb4bb106bc29cadb6f5486ac4ef52662d56"} Jul 06 23:43:20.080769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:20.080668 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kzzq4" podStartSLOduration=9.463849549 podStartE2EDuration="41.080651827s" totalImagesPullingTime="31.616802278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:20.080572563 +0000 UTC m=+40.781333385" watchObservedRunningTime="2026-07-06 23:43:20.080651827 +0000 UTC m=+40.781412647" Jul 06 23:43:21.816980 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:21.816947 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:21.816980 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:21.816965 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:21.817438 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:21.817040 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:21.817438 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:21.817149 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:21.817438 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:21.817199 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:21.817438 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:21.817254 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:23.817259 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:23.817223 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:23.817259 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:23.817254 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:23.817708 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:23.817235 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:23.817708 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:23.817327 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:23.817708 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:23.817428 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:23.817708 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:23.817526 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:25.816845 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:25.816809 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:25.816845 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:25.816829 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:25.817432 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:25.816814 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:25.817432 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:25.816931 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:25.817432 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:25.817074 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:25.817432 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:25.817148 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:27.816606 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:27.816572 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:27.816997 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:27.816573 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:27.816997 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:27.816673 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7npf" podUID="5c36d839-023b-4f3e-bf97-3087b873d045" Jul 06 23:43:27.816997 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:27.816578 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:27.816997 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:27.816751 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2kv8z" podUID="d278ac22-c4f7-44f3-aa11-7cead2913c95" Jul 06 23:43:27.816997 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:27.816808 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jh2wg" podUID="2b522481-71e4-4b14-9212-e483310aa5c2" Jul 06 23:43:28.106711 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.106679 2600 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeReady" Jul 06 23:43:28.106902 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.106833 2600 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 23:43:28.152178 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.152148 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85db65fc77-qbt5g"] Jul 06 23:43:28.188703 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.188672 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85db65fc77-qbt5g"] Jul 06 23:43:28.188703 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.188705 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shfxp"] Jul 06 23:43:28.188907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.188782 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.192905 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.192882 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 23:43:28.193026 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.193016 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fdhzs\"" Jul 06 23:43:28.193189 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.193173 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 23:43:28.194179 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.194162 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 23:43:28.199227 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.199208 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 23:43:28.202146 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.202129 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4qfc6"] Jul 06 23:43:28.202254 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.202239 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.204694 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.204678 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dsbmx\"" Jul 06 23:43:28.204824 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.204744 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 23:43:28.204899 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.204839 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 23:43:28.205133 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.205117 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 23:43:28.205229 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.205156 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 23:43:28.218640 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.218613 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qfc6"] Jul 06 23:43:28.218768 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.218664 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shfxp"] Jul 06 23:43:28.218827 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.218781 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.221563 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.221536 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 23:43:28.221858 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.221831 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 23:43:28.221947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.221864 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9whhz\"" Jul 06 23:43:28.221996 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.221982 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 23:43:28.278723 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.278688 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4f4x"] Jul 06 23:43:28.291232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291205 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzx5j\" (UniqueName: \"kubernetes.io/projected/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-api-access-nzx5j\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.291344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291234 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-installation-pull-secrets\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291257 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-bound-sa-token\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291273 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69t64\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-kube-api-access-69t64\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291288 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7875175-cdd9-4607-8656-1ad4415063b6-cert\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.291344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291305 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-image-registry-private-configuration\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291352 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d32d430b-02c4-463e-9c35-0b3290677fc8-crio-socket\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291373 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-tls\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291394 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-certificates\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291412 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d32d430b-02c4-463e-9c35-0b3290677fc8-data-volume\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291431 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d32d430b-02c4-463e-9c35-0b3290677fc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291485 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-ca-trust-extracted\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.291560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291517 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccwd2\" (UniqueName: \"kubernetes.io/projected/b7875175-cdd9-4607-8656-1ad4415063b6-kube-api-access-ccwd2\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.291816 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291585 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.291816 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.291667 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-trusted-ca\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.294195 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.294175 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4f4x"] Jul 06 23:43:28.294290 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.294261 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.296902 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.296652 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 23:43:28.296902 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.296683 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94g74\"" Jul 06 23:43:28.297106 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.296984 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 23:43:28.392872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392786 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-ca-trust-extracted\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.392872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392820 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccwd2\" (UniqueName: \"kubernetes.io/projected/b7875175-cdd9-4607-8656-1ad4415063b6-kube-api-access-ccwd2\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.392872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392837 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-tmp-dir\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.392872 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392869 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392896 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-trusted-ca\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392917 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-metrics-tls\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392951 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzx5j\" (UniqueName: \"kubernetes.io/projected/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-api-access-nzx5j\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392975 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-installation-pull-secrets\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.392995 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-config-volume\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393022 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-bound-sa-token\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393074 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69t64\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-kube-api-access-69t64\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393096 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7875175-cdd9-4607-8656-1ad4415063b6-cert\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393120 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlsx\" (UniqueName: \"kubernetes.io/projected/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-kube-api-access-xtlsx\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393146 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-image-registry-private-configuration\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393192 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d32d430b-02c4-463e-9c35-0b3290677fc8-crio-socket\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393221 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-tls\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393252 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-certificates\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393279 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d32d430b-02c4-463e-9c35-0b3290677fc8-data-volume\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393298 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-ca-trust-extracted\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.393946 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393335 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d32d430b-02c4-463e-9c35-0b3290677fc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393946 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393532 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393946 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393645 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d32d430b-02c4-463e-9c35-0b3290677fc8-crio-socket\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.393946 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.393892 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d32d430b-02c4-463e-9c35-0b3290677fc8-data-volume\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.394126 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.394009 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-trusted-ca\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.394204 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.394171 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-certificates\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.397447 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.397421 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d32d430b-02c4-463e-9c35-0b3290677fc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.397568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.397511 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7875175-cdd9-4607-8656-1ad4415063b6-cert\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.397568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.397527 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-installation-pull-secrets\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.397568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.397557 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-registry-tls\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.397722 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.397568 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-image-registry-private-configuration\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.409487 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.409468 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-bound-sa-token\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.409700 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.409679 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccwd2\" (UniqueName: \"kubernetes.io/projected/b7875175-cdd9-4607-8656-1ad4415063b6-kube-api-access-ccwd2\") pod \"ingress-canary-4qfc6\" (UID: \"b7875175-cdd9-4607-8656-1ad4415063b6\") " pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.415421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.415400 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69t64\" (UniqueName: \"kubernetes.io/projected/6c5e54e1-d15d-4fbd-87fa-9cbff019e01d-kube-api-access-69t64\") pod \"image-registry-85db65fc77-qbt5g\" (UID: \"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d\") " pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.419899 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.419882 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzx5j\" (UniqueName: \"kubernetes.io/projected/d32d430b-02c4-463e-9c35-0b3290677fc8-kube-api-access-nzx5j\") pod \"insights-runtime-extractor-shfxp\" (UID: \"d32d430b-02c4-463e-9c35-0b3290677fc8\") " pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.453241 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.453213 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-67v4v"] Jul 06 23:43:28.474398 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.474378 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-67v4v"] Jul 06 23:43:28.474491 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.474461 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:28.479002 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.478960 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 23:43:28.479128 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.479096 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 23:43:28.479253 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.479235 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t9znq\"" Jul 06 23:43:28.493838 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.493816 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-config-volume\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.493941 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.493845 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qw9\" (UniqueName: \"kubernetes.io/projected/62f2e392-4906-44e8-bffd-727f76e8a727-kube-api-access-d9qw9\") pod \"downloads-685bfb5f64-67v4v\" (UID: \"62f2e392-4906-44e8-bffd-727f76e8a727\") " pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:28.493941 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.493867 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlsx\" (UniqueName: \"kubernetes.io/projected/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-kube-api-access-xtlsx\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.494044 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.493953 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-tmp-dir\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.494044 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.493989 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-metrics-tls\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.494271 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.494253 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-tmp-dir\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.494409 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.494391 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-config-volume\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.496371 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.496350 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-metrics-tls\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.499539 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.499522 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:28.502146 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.502129 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlsx\" (UniqueName: \"kubernetes.io/projected/aa769a2b-b799-46ae-bd32-b34cd1d28fa9-kube-api-access-xtlsx\") pod \"dns-default-b4f4x\" (UID: \"aa769a2b-b799-46ae-bd32-b34cd1d28fa9\") " pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.511091 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.511042 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shfxp" Jul 06 23:43:28.527418 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.527392 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qfc6" Jul 06 23:43:28.594955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.594920 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qw9\" (UniqueName: \"kubernetes.io/projected/62f2e392-4906-44e8-bffd-727f76e8a727-kube-api-access-d9qw9\") pod \"downloads-685bfb5f64-67v4v\" (UID: \"62f2e392-4906-44e8-bffd-727f76e8a727\") " pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:28.604139 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.603403 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:28.604734 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.604648 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qw9\" (UniqueName: \"kubernetes.io/projected/62f2e392-4906-44e8-bffd-727f76e8a727-kube-api-access-d9qw9\") pod \"downloads-685bfb5f64-67v4v\" (UID: \"62f2e392-4906-44e8-bffd-727f76e8a727\") " pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:28.704201 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.704123 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shfxp"] Jul 06 23:43:28.726925 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.726885 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85db65fc77-qbt5g"] Jul 06 23:43:28.730699 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:28.730673 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5e54e1_d15d_4fbd_87fa_9cbff019e01d.slice/crio-d1b1e703204f48cd3a699ea79ab45e509e06f4c76b383e3c764380bb1ed3980e WatchSource:0}: Error finding container d1b1e703204f48cd3a699ea79ab45e509e06f4c76b383e3c764380bb1ed3980e: Status 404 returned error can't find the container with id d1b1e703204f48cd3a699ea79ab45e509e06f4c76b383e3c764380bb1ed3980e Jul 06 23:43:28.783242 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.783216 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:28.791340 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.791311 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4f4x"] Jul 06 23:43:28.915977 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.915896 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-67v4v"] Jul 06 23:43:28.919396 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:28.919369 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f2e392_4906_44e8_bffd_727f76e8a727.slice/crio-7a112672d3ee5a62664c9b5aac32af41ea1f5420a2d5d57d21ebb62f00108d8c WatchSource:0}: Error finding container 7a112672d3ee5a62664c9b5aac32af41ea1f5420a2d5d57d21ebb62f00108d8c: Status 404 returned error can't find the container with id 7a112672d3ee5a62664c9b5aac32af41ea1f5420a2d5d57d21ebb62f00108d8c Jul 06 23:43:28.929997 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:28.929971 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qfc6"] Jul 06 23:43:28.935925 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:28.935860 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7875175_cdd9_4607_8656_1ad4415063b6.slice/crio-b509c1794f84a7850e7604a42483a5a6d263ece860b36c8bc01dbe961a1b1635 WatchSource:0}: Error finding container b509c1794f84a7850e7604a42483a5a6d263ece860b36c8bc01dbe961a1b1635: Status 404 returned error can't find the container with id b509c1794f84a7850e7604a42483a5a6d263ece860b36c8bc01dbe961a1b1635 Jul 06 23:43:29.079801 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.079763 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-67v4v" event={"ID":"62f2e392-4906-44e8-bffd-727f76e8a727","Type":"ContainerStarted","Data":"7a112672d3ee5a62664c9b5aac32af41ea1f5420a2d5d57d21ebb62f00108d8c"} Jul 06 23:43:29.081819 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.081777 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" event={"ID":"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d","Type":"ContainerStarted","Data":"a32c0558a4b6abd808d23d7a115038557700dbe42acc07a7d9af77ac95d6497f"} Jul 06 23:43:29.081957 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.081828 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" event={"ID":"6c5e54e1-d15d-4fbd-87fa-9cbff019e01d","Type":"ContainerStarted","Data":"d1b1e703204f48cd3a699ea79ab45e509e06f4c76b383e3c764380bb1ed3980e"} Jul 06 23:43:29.081957 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.081898 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:29.083863 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.083837 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4f4x" event={"ID":"aa769a2b-b799-46ae-bd32-b34cd1d28fa9","Type":"ContainerStarted","Data":"dbacc49c9f913381470ed75dd5ed6cdb3362b8481dfd6c2958dcdc56fdb10348"} Jul 06 23:43:29.085243 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.085206 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qfc6" event={"ID":"b7875175-cdd9-4607-8656-1ad4415063b6","Type":"ContainerStarted","Data":"b509c1794f84a7850e7604a42483a5a6d263ece860b36c8bc01dbe961a1b1635"} Jul 06 23:43:29.086415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.086389 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shfxp" event={"ID":"d32d430b-02c4-463e-9c35-0b3290677fc8","Type":"ContainerStarted","Data":"c1e659fd2716e46987c56bd58afe69c30801ba6f97d8649b9d9210da6ef49a5a"} Jul 06 23:43:29.108881 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.106792 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" podStartSLOduration=2.106774683 podStartE2EDuration="2.106774683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:29.106542018 +0000 UTC m=+49.807302839" watchObservedRunningTime="2026-07-06 23:43:29.106774683 +0000 UTC m=+49.807535507" Jul 06 23:43:29.819198 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.819167 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:29.820108 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.819797 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:29.820108 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.819958 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:29.823419 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823194 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:43:29.823419 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823223 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:43:29.823419 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823296 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:43:29.823419 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823395 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:43:29.823699 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823508 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsqvs\"" Jul 06 23:43:29.823754 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:29.823707 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pwj6r\"" Jul 06 23:43:32.949475 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.949441 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:43:32.964530 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.964499 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:32.967541 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.967393 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:43:32.967541 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.967475 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:43:32.967744 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.967549 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:43:32.968590 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.968570 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9bqw6\"" Jul 06 23:43:32.968689 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.968600 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:43:32.968859 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.968837 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:43:32.970381 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:32.970360 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:43:33.034647 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034609 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.034807 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034660 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.034807 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034690 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.034807 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034793 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.034984 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034828 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8xq\" (UniqueName: \"kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.034984 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.034861 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136066 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136011 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136066 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136070 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136276 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136091 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136276 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136138 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136276 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136164 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8xq\" (UniqueName: \"kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136276 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136182 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136827 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136792 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.136945 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.136842 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.137145 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.137126 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.138817 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.138784 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.139066 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.139036 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.145228 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.145176 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8xq\" (UniqueName: \"kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq\") pod \"console-9796d978-5f6n5\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:33.274694 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:33.274655 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:35.512695 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:35.512609 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:43:35.516317 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:35.516281 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76195a0_c393_4ae3_853e_cc21de4ffc02.slice/crio-b6af1cbb88cc357bc5b01783e70233199a47ea673dcfb19c2ec74199799056b5 WatchSource:0}: Error finding container b6af1cbb88cc357bc5b01783e70233199a47ea673dcfb19c2ec74199799056b5: Status 404 returned error can't find the container with id b6af1cbb88cc357bc5b01783e70233199a47ea673dcfb19c2ec74199799056b5 Jul 06 23:43:36.108927 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.108897 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4f4x" event={"ID":"aa769a2b-b799-46ae-bd32-b34cd1d28fa9","Type":"ContainerStarted","Data":"acef262e43303f72dbce37deeba4aa0446c2bc9445c665f83717bd3bfbae4c12"} Jul 06 23:43:36.109036 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.108969 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:36.109036 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.108997 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4f4x" event={"ID":"aa769a2b-b799-46ae-bd32-b34cd1d28fa9","Type":"ContainerStarted","Data":"3ca975914e7fd79011996f48c98c179814a3fa99465a46c94b4a49adb88d9f07"} Jul 06 23:43:36.110749 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.110723 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qfc6" event={"ID":"b7875175-cdd9-4607-8656-1ad4415063b6","Type":"ContainerStarted","Data":"2d39c8dda91989149741210be98e8f15c3e4707ba657c9ca47959a5ae2f8833a"} Jul 06 23:43:36.113335 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.113313 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shfxp" event={"ID":"d32d430b-02c4-463e-9c35-0b3290677fc8","Type":"ContainerStarted","Data":"122e9551118e195ca67d8dc073bb343664c00a24f9daad3bcdabab0344f7247e"} Jul 06 23:43:36.114753 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.114733 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9796d978-5f6n5" event={"ID":"d76195a0-c393-4ae3-853e-cc21de4ffc02","Type":"ContainerStarted","Data":"b6af1cbb88cc357bc5b01783e70233199a47ea673dcfb19c2ec74199799056b5"} Jul 06 23:43:36.133077 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.132903 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b4f4x" podStartSLOduration=1.57486207 podStartE2EDuration="8.132876205s" totalImagesPullingTime="6.558014135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:36.128199855 +0000 UTC m=+56.828960701" watchObservedRunningTime="2026-07-06 23:43:36.132876205 +0000 UTC m=+56.833637025" Jul 06 23:43:36.145071 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:36.145002 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4qfc6" podStartSLOduration=1.7042896779999999 podStartE2EDuration="8.144982804s" totalImagesPullingTime="6.440693126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:36.144499335 +0000 UTC m=+56.845260186" watchObservedRunningTime="2026-07-06 23:43:36.144982804 +0000 UTC m=+56.845743626" Jul 06 23:43:37.122561 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:37.122105 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shfxp" event={"ID":"d32d430b-02c4-463e-9c35-0b3290677fc8","Type":"ContainerStarted","Data":"1bc4d285fd0b80b2b8f8aaea86b33c041fa050c273037253b53166700c1fec6e"} Jul 06 23:43:42.038534 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:42.038499 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztc8r" Jul 06 23:43:45.379515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.379474 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-t484g"] Jul 06 23:43:45.419090 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.419033 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-t484g"] Jul 06 23:43:45.419275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.419176 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.422578 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.422551 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 23:43:45.422731 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.422579 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 23:43:45.422731 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.422552 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 23:43:45.423809 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.423690 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 23:43:45.423809 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.423730 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wdwkq\"" Jul 06 23:43:45.423809 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.423776 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 23:43:45.539911 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.539875 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.540132 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.540006 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:45.540132 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.540091 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.540132 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.540126 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad938dad-3709-4ccc-ae4b-e77a2597bb26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.540297 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.540164 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4jb\" (UniqueName: \"kubernetes.io/projected/ad938dad-3709-4ccc-ae4b-e77a2597bb26-kube-api-access-5z4jb\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.542688 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.542663 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 23:43:45.552817 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.552788 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c36d839-023b-4f3e-bf97-3087b873d045-metrics-certs\") pod \"network-metrics-daemon-b7npf\" (UID: \"5c36d839-023b-4f3e-bf97-3087b873d045\") " pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:45.641265 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641169 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.641265 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641249 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:45.641483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641279 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.641483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641306 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad938dad-3709-4ccc-ae4b-e77a2597bb26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.641483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641345 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4jb\" (UniqueName: \"kubernetes.io/projected/ad938dad-3709-4ccc-ae4b-e77a2597bb26-kube-api-access-5z4jb\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.641483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.641380 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:45.642197 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.642175 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad938dad-3709-4ccc-ae4b-e77a2597bb26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.644136 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.644108 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.644261 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.644120 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad938dad-3709-4ccc-ae4b-e77a2597bb26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.644327 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.644316 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 23:43:45.644364 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.644340 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 23:43:45.650988 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.650966 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4jb\" (UniqueName: \"kubernetes.io/projected/ad938dad-3709-4ccc-ae4b-e77a2597bb26-kube-api-access-5z4jb\") pod \"prometheus-operator-567f7b8b7c-t484g\" (UID: \"ad938dad-3709-4ccc-ae4b-e77a2597bb26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.654793 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.654773 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b522481-71e4-4b14-9212-e483310aa5c2-original-pull-secret\") pod \"global-pull-secret-syncer-jh2wg\" (UID: \"2b522481-71e4-4b14-9212-e483310aa5c2\") " pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:45.655170 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.655150 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 23:43:45.666397 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.666361 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2vj\" (UniqueName: \"kubernetes.io/projected/d278ac22-c4f7-44f3-aa11-7cead2913c95-kube-api-access-lz2vj\") pod \"network-check-target-2kv8z\" (UID: \"d278ac22-c4f7-44f3-aa11-7cead2913c95\") " pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:45.730280 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.730244 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" Jul 06 23:43:45.737277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.737248 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsqvs\"" Jul 06 23:43:45.744562 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.744535 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7npf" Jul 06 23:43:45.754266 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.754240 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pwj6r\"" Jul 06 23:43:45.761492 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.761470 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jh2wg" Jul 06 23:43:45.762527 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:45.762508 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:46.124843 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:46.124814 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4f4x" Jul 06 23:43:47.598039 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:47.598009 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jh2wg"] Jul 06 23:43:47.601853 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:47.601823 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b522481_71e4_4b14_9212_e483310aa5c2.slice/crio-1cb8533b130645160ab8920bd65a1baa1046b8bae3f65019d42f54b3fa40ee1b WatchSource:0}: Error finding container 1cb8533b130645160ab8920bd65a1baa1046b8bae3f65019d42f54b3fa40ee1b: Status 404 returned error can't find the container with id 1cb8533b130645160ab8920bd65a1baa1046b8bae3f65019d42f54b3fa40ee1b Jul 06 23:43:47.828508 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:47.828388 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7npf"] Jul 06 23:43:47.829667 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:47.829488 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2kv8z"] Jul 06 23:43:47.831308 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:47.831276 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-t484g"] Jul 06 23:43:47.833299 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:47.833269 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c36d839_023b_4f3e_bf97_3087b873d045.slice/crio-d9871c4e037f13321951a96100c71ca37e6da74415dda79a35bd2891041cdd09 WatchSource:0}: Error finding container d9871c4e037f13321951a96100c71ca37e6da74415dda79a35bd2891041cdd09: Status 404 returned error can't find the container with id d9871c4e037f13321951a96100c71ca37e6da74415dda79a35bd2891041cdd09 Jul 06 23:43:47.834759 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:47.834735 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd278ac22_c4f7_44f3_aa11_7cead2913c95.slice/crio-d70e3fbb1c2fe710d714af68bc5ef489c5da3e7692508216a5719977f6bfc303 WatchSource:0}: Error finding container d70e3fbb1c2fe710d714af68bc5ef489c5da3e7692508216a5719977f6bfc303: Status 404 returned error can't find the container with id d70e3fbb1c2fe710d714af68bc5ef489c5da3e7692508216a5719977f6bfc303 Jul 06 23:43:47.835485 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:47.835367 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad938dad_3709_4ccc_ae4b_e77a2597bb26.slice/crio-0f27394b6f2395df94e06fd5861ec3b79774f7e827c024ec2b15a9fb122e3014 WatchSource:0}: Error finding container 0f27394b6f2395df94e06fd5861ec3b79774f7e827c024ec2b15a9fb122e3014: Status 404 returned error can't find the container with id 0f27394b6f2395df94e06fd5861ec3b79774f7e827c024ec2b15a9fb122e3014 Jul 06 23:43:48.165142 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.164269 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shfxp" event={"ID":"d32d430b-02c4-463e-9c35-0b3290677fc8","Type":"ContainerStarted","Data":"c2e50109dff0a650549ea09f934ebe17c61494e454c09e51a6eb8720821dbb99"} Jul 06 23:43:48.167601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.167500 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9796d978-5f6n5" event={"ID":"d76195a0-c393-4ae3-853e-cc21de4ffc02","Type":"ContainerStarted","Data":"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b"} Jul 06 23:43:48.170125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.170091 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2kv8z" event={"ID":"d278ac22-c4f7-44f3-aa11-7cead2913c95","Type":"ContainerStarted","Data":"d70e3fbb1c2fe710d714af68bc5ef489c5da3e7692508216a5719977f6bfc303"} Jul 06 23:43:48.172790 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.172719 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7npf" event={"ID":"5c36d839-023b-4f3e-bf97-3087b873d045","Type":"ContainerStarted","Data":"d9871c4e037f13321951a96100c71ca37e6da74415dda79a35bd2891041cdd09"} Jul 06 23:43:48.174379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.174352 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" event={"ID":"ad938dad-3709-4ccc-ae4b-e77a2597bb26","Type":"ContainerStarted","Data":"0f27394b6f2395df94e06fd5861ec3b79774f7e827c024ec2b15a9fb122e3014"} Jul 06 23:43:48.178932 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.176848 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-67v4v" event={"ID":"62f2e392-4906-44e8-bffd-727f76e8a727","Type":"ContainerStarted","Data":"caeec77e7ad913afda8f1ae94155c9d79db000a66969ecf7bf3019323a4fa26f"} Jul 06 23:43:48.178932 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.177352 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:48.179190 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.179169 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh2wg" event={"ID":"2b522481-71e4-4b14-9212-e483310aa5c2","Type":"ContainerStarted","Data":"1cb8533b130645160ab8920bd65a1baa1046b8bae3f65019d42f54b3fa40ee1b"} Jul 06 23:43:48.184045 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.183314 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shfxp" podStartSLOduration=1.6085428579999999 podStartE2EDuration="20.183294852s" totalImagesPullingTime="18.574751994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:48.181693876 +0000 UTC m=+68.882454707" watchObservedRunningTime="2026-07-06 23:43:48.183294852 +0000 UTC m=+68.884055673" Jul 06 23:43:48.191466 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.191438 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-67v4v" Jul 06 23:43:48.198425 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.198213 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-67v4v" podStartSLOduration=1.646367053 podStartE2EDuration="20.198195774s" totalImagesPullingTime="18.551828721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:48.196684556 +0000 UTC m=+68.897445368" watchObservedRunningTime="2026-07-06 23:43:48.198195774 +0000 UTC m=+68.898956595" Jul 06 23:43:48.216088 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.215008 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9796d978-5f6n5" podStartSLOduration=4.31367978 podStartE2EDuration="16.214986497s" totalImagesPullingTime="11.901306717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:48.214123612 +0000 UTC m=+68.914884458" watchObservedRunningTime="2026-07-06 23:43:48.214986497 +0000 UTC m=+68.915747390" Jul 06 23:43:48.508083 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.507970 2600 patch_prober.go:28] interesting pod/image-registry-85db65fc77-qbt5g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 23:43:48.508343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:48.508043 2600 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" podUID="6c5e54e1-d15d-4fbd-87fa-9cbff019e01d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:43:50.099163 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:50.098263 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85db65fc77-qbt5g" Jul 06 23:43:51.210301 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:51.210273 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7npf" event={"ID":"5c36d839-023b-4f3e-bf97-3087b873d045","Type":"ContainerStarted","Data":"744de710411fce42b03f45978d248ef893229f8c1583c67d89c51ff22c90c373"} Jul 06 23:43:51.212918 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:51.212825 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" event={"ID":"ad938dad-3709-4ccc-ae4b-e77a2597bb26","Type":"ContainerStarted","Data":"8a1931cf97a04e359a4a41cee72c09e8556cbf765d742cd82317ca614ae001fa"} Jul 06 23:43:52.222408 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:52.222251 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" event={"ID":"ad938dad-3709-4ccc-ae4b-e77a2597bb26","Type":"ContainerStarted","Data":"a04f144c8a7b8c046aa7f1c71aa13aaaf478cec1ada2e425c1258780ee3c7ee2"} Jul 06 23:43:52.225409 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:52.225378 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7npf" event={"ID":"5c36d839-023b-4f3e-bf97-3087b873d045","Type":"ContainerStarted","Data":"566a2e2b512a1b38bb4d0dca92bb847d2c8010d244e870ce77175b48146ecd92"} Jul 06 23:43:52.259082 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:52.259007 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-t484g" podStartSLOduration=4.084249745 podStartE2EDuration="7.258985896s" totalImagesPullingTime="3.174736151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.2412262 +0000 UTC m=+72.941987022" watchObservedRunningTime="2026-07-06 23:43:52.258985896 +0000 UTC m=+72.959746717" Jul 06 23:43:52.259576 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:52.259534 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b7npf" podStartSLOduration=70.0862521 podStartE2EDuration="1m13.259520761s" totalImagesPullingTime="3.173268661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:52.258378291 +0000 UTC m=+72.959139132" watchObservedRunningTime="2026-07-06 23:43:52.259520761 +0000 UTC m=+72.960281584" Jul 06 23:43:53.275653 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.275615 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:53.276255 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.275816 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:53.282513 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.282482 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:53.838196 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.838155 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m"] Jul 06 23:43:53.882782 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.882739 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nnb8w"] Jul 06 23:43:53.882965 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.882902 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:53.887304 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.887270 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 23:43:53.887482 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.887363 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 23:43:53.887541 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.887512 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 23:43:53.887612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.887594 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gnfdb\"" Jul 06 23:43:53.910440 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.910406 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m"] Jul 06 23:43:53.910596 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.910565 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:53.913388 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.913360 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jvgrg\"" Jul 06 23:43:53.913620 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.913595 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 23:43:53.914137 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.913789 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 23:43:53.914137 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:53.913996 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 23:43:54.022970 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.022930 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-sys\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.022983 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023014 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-wtmp\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023106 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023135 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023176 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023205 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvhs\" (UniqueName: \"kubernetes.io/projected/afd4ba76-0715-419f-a1af-cc2035aaeef9-kube-api-access-lkvhs\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023238 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023265 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023286 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-metrics-client-ca\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023316 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn6x4\" (UniqueName: \"kubernetes.io/projected/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-api-access-mn6x4\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023346 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-textfile\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023370 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023398 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.023614 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.023420 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-root\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124091 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.123967 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124091 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124008 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124091 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124041 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-root\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124101 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-sys\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124130 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124151 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-wtmp\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124225 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124247 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124277 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124306 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvhs\" (UniqueName: \"kubernetes.io/projected/afd4ba76-0715-419f-a1af-cc2035aaeef9-kube-api-access-lkvhs\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124335 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124360 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124384 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-metrics-client-ca\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.124874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124410 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn6x4\" (UniqueName: \"kubernetes.io/projected/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-api-access-mn6x4\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.124874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.124431 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-textfile\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.125138 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-root\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.125161 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-wtmp\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.125231 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afd4ba76-0715-419f-a1af-cc2035aaeef9-sys\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.125360 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-textfile\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.125361 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:54.125467 2600 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 23:43:54.125882 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:43:54.125543 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls podName:afd4ba76-0715-419f-a1af-cc2035aaeef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:54.625521 +0000 UTC m=+75.326281813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls") pod "node-exporter-nnb8w" (UID: "afd4ba76-0715-419f-a1af-cc2035aaeef9") : secret "node-exporter-tls" not found Jul 06 23:43:54.126375 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.126351 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.126783 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.126755 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.126879 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.126796 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.127284 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.127248 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afd4ba76-0715-419f-a1af-cc2035aaeef9-metrics-client-ca\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.129686 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.129641 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.130442 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.130417 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.142841 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.142815 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.145334 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.145311 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvhs\" (UniqueName: \"kubernetes.io/projected/afd4ba76-0715-419f-a1af-cc2035aaeef9-kube-api-access-lkvhs\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.155893 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.155861 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn6x4\" (UniqueName: \"kubernetes.io/projected/1e0f96fa-6365-470d-bbd3-e546f5abe6ef-kube-api-access-mn6x4\") pod \"kube-state-metrics-7c9dbb8b7d-hh97m\" (UID: \"1e0f96fa-6365-470d-bbd3-e546f5abe6ef\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.195901 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.195861 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" Jul 06 23:43:54.239032 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.239000 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:43:54.629077 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.629024 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.632146 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.632117 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/afd4ba76-0715-419f-a1af-cc2035aaeef9-node-exporter-tls\") pod \"node-exporter-nnb8w\" (UID: \"afd4ba76-0715-419f-a1af-cc2035aaeef9\") " pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:54.823408 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:54.823371 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnb8w" Jul 06 23:43:55.207415 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:55.207374 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd4ba76_0715_419f_a1af_cc2035aaeef9.slice/crio-ef91ae4afa4787a347af03b34ab4bf6ba6718e73333fbefe7a310fae2a07bc14 WatchSource:0}: Error finding container ef91ae4afa4787a347af03b34ab4bf6ba6718e73333fbefe7a310fae2a07bc14: Status 404 returned error can't find the container with id ef91ae4afa4787a347af03b34ab4bf6ba6718e73333fbefe7a310fae2a07bc14 Jul 06 23:43:55.241308 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:55.241266 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnb8w" event={"ID":"afd4ba76-0715-419f-a1af-cc2035aaeef9","Type":"ContainerStarted","Data":"ef91ae4afa4787a347af03b34ab4bf6ba6718e73333fbefe7a310fae2a07bc14"} Jul 06 23:43:55.376083 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:55.375362 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m"] Jul 06 23:43:55.381195 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:43:55.381164 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0f96fa_6365_470d_bbd3_e546f5abe6ef.slice/crio-0b872373aca8994c60e9edd8dfec37ee5868fd02773d9fa099d3f9f945551113 WatchSource:0}: Error finding container 0b872373aca8994c60e9edd8dfec37ee5868fd02773d9fa099d3f9f945551113: Status 404 returned error can't find the container with id 0b872373aca8994c60e9edd8dfec37ee5868fd02773d9fa099d3f9f945551113 Jul 06 23:43:56.248737 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.248630 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2kv8z" event={"ID":"d278ac22-c4f7-44f3-aa11-7cead2913c95","Type":"ContainerStarted","Data":"cd810e9ae99d36b3ba9a71412c3d7ebda82a5bd168e1a1eba7fd7375f63af966"} Jul 06 23:43:56.248737 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.248701 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:43:56.253175 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.252601 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jh2wg" event={"ID":"2b522481-71e4-4b14-9212-e483310aa5c2","Type":"ContainerStarted","Data":"1735032c1b338444703c43a9ff5d8760c20b70c710f4ab502f08cc8d83027bb8"} Jul 06 23:43:56.255865 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.255792 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" event={"ID":"1e0f96fa-6365-470d-bbd3-e546f5abe6ef","Type":"ContainerStarted","Data":"0b872373aca8994c60e9edd8dfec37ee5868fd02773d9fa099d3f9f945551113"} Jul 06 23:43:56.264965 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.264881 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2kv8z" podStartSLOduration=69.898712828 podStartE2EDuration="1m17.264861751s" totalImagesPullingTime="7.366148923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:56.264226901 +0000 UTC m=+76.964987756" watchObservedRunningTime="2026-07-06 23:43:56.264861751 +0000 UTC m=+76.965622575" Jul 06 23:43:56.283921 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:56.283197 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jh2wg" podStartSLOduration=68.671651928 podStartE2EDuration="1m16.283168382s" totalImagesPullingTime="7.611516454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:56.282362117 +0000 UTC m=+76.983122938" watchObservedRunningTime="2026-07-06 23:43:56.283168382 +0000 UTC m=+76.983929208" Jul 06 23:43:57.260125 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:57.260094 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnb8w" event={"ID":"afd4ba76-0715-419f-a1af-cc2035aaeef9","Type":"ContainerStarted","Data":"ac79772289e4cda7d4ba1cab9d4acf292ecfb4946fd858cf79fa708572506a85"} Jul 06 23:43:57.972404 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:57.972313 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:43:58.265425 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.265383 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" event={"ID":"1e0f96fa-6365-470d-bbd3-e546f5abe6ef","Type":"ContainerStarted","Data":"bbfc6171c3fdfe56a64578c90360d02fff929eaba6db605d160015c7017580b5"} Jul 06 23:43:58.265966 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.265449 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" event={"ID":"1e0f96fa-6365-470d-bbd3-e546f5abe6ef","Type":"ContainerStarted","Data":"516ad04adbec05e4de88537c75304f722ffe6abb60670997b9921ea92daad134"} Jul 06 23:43:58.265966 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.265479 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" event={"ID":"1e0f96fa-6365-470d-bbd3-e546f5abe6ef","Type":"ContainerStarted","Data":"130329da650595bc030bd2612df4083a3a15e52a7480c08d545b222813c5b3be"} Jul 06 23:43:58.267158 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.267133 2600 generic.go:356] "Generic (PLEG): container finished" podID="afd4ba76-0715-419f-a1af-cc2035aaeef9" containerID="ac79772289e4cda7d4ba1cab9d4acf292ecfb4946fd858cf79fa708572506a85" exitCode=0 Jul 06 23:43:58.267294 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.267223 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnb8w" event={"ID":"afd4ba76-0715-419f-a1af-cc2035aaeef9","Type":"ContainerDied","Data":"ac79772289e4cda7d4ba1cab9d4acf292ecfb4946fd858cf79fa708572506a85"} Jul 06 23:43:58.283240 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:58.283170 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-hh97m" podStartSLOduration=3.228731752 podStartE2EDuration="5.283148291s" totalImagesPullingTime="2.054416539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:58.282917854 +0000 UTC m=+78.983678694" watchObservedRunningTime="2026-07-06 23:43:58.283148291 +0000 UTC m=+78.983909112" Jul 06 23:43:59.272945 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:59.272905 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnb8w" event={"ID":"afd4ba76-0715-419f-a1af-cc2035aaeef9","Type":"ContainerStarted","Data":"edbeac62e55e97778100488110b495780d0580a3ef6e4499fbf8f3a8394e9f2d"} Jul 06 23:43:59.273491 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:59.272962 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnb8w" event={"ID":"afd4ba76-0715-419f-a1af-cc2035aaeef9","Type":"ContainerStarted","Data":"48ded81b3fcc4a7d6cadfc881c78729385f6cbb830bfb4ccd686eaf4ba41a45e"} Jul 06 23:43:59.297689 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:43:59.296093 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nnb8w" podStartSLOduration=4.258683641 podStartE2EDuration="6.296070446s" totalImagesPullingTime="1.948882745s" totalInitContainerRuntime="88.50406ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:59.292772777 +0000 UTC m=+79.993533612" watchObservedRunningTime="2026-07-06 23:43:59.296070446 +0000 UTC m=+79.996831262" Jul 06 23:44:22.996972 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:22.996930 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9796d978-5f6n5" podUID="d76195a0-c393-4ae3-853e-cc21de4ffc02" containerName="console" containerID="cri-o://233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b" gracePeriod=15 Jul 06 23:44:23.269152 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.269084 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:44:23.339207 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339172 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339221 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339259 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339293 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339335 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339411 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339369 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc8xq\" (UniqueName: \"kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq\") pod \"d76195a0-c393-4ae3-853e-cc21de4ffc02\" (UID: \"d76195a0-c393-4ae3-853e-cc21de4ffc02\") " Jul 06 23:44:23.339710 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339673 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:44:23.339797 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339680 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca" (OuterVolumeSpecName: "service-ca") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:44:23.339797 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.339733 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config" (OuterVolumeSpecName: "console-config") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:44:23.341640 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.341610 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:44:23.341761 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.341689 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:44:23.341761 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.341700 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq" (OuterVolumeSpecName: "kube-api-access-zc8xq") pod "d76195a0-c393-4ae3-853e-cc21de4ffc02" (UID: "d76195a0-c393-4ae3-853e-cc21de4ffc02"). InnerVolumeSpecName "kube-api-access-zc8xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:44:23.355766 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.355734 2600 generic.go:356] "Generic (PLEG): container finished" podID="d76195a0-c393-4ae3-853e-cc21de4ffc02" containerID="233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b" exitCode=0 Jul 06 23:44:23.355876 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.355782 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9796d978-5f6n5" Jul 06 23:44:23.355876 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.355789 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9796d978-5f6n5" event={"ID":"d76195a0-c393-4ae3-853e-cc21de4ffc02","Type":"ContainerDied","Data":"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b"} Jul 06 23:44:23.355876 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.355859 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9796d978-5f6n5" event={"ID":"d76195a0-c393-4ae3-853e-cc21de4ffc02","Type":"ContainerDied","Data":"b6af1cbb88cc357bc5b01783e70233199a47ea673dcfb19c2ec74199799056b5"} Jul 06 23:44:23.355973 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.355879 2600 scope.go:117] "RemoveContainer" containerID="233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b" Jul 06 23:44:23.364211 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.364193 2600 scope.go:117] "RemoveContainer" containerID="233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b" Jul 06 23:44:23.364482 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:44:23.364462 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b\": container with ID starting with 233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b not found: ID does not exist" containerID="233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b" Jul 06 23:44:23.364524 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.364493 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b"} err="failed to get container status \"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b\": rpc error: code = NotFound desc = could not find container \"233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b\": container with ID starting with 233d0a2f6f104e88e45687783ed767a868edf7b8c4497c97fda96f0014b60c1b not found: ID does not exist" Jul 06 23:44:23.379575 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.379550 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:44:23.384234 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.384214 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9796d978-5f6n5"] Jul 06 23:44:23.440034 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440008 2600 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.440034 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440031 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc8xq\" (UniqueName: \"kubernetes.io/projected/d76195a0-c393-4ae3-853e-cc21de4ffc02-kube-api-access-zc8xq\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.440034 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440042 2600 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.440280 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440070 2600 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d76195a0-c393-4ae3-853e-cc21de4ffc02-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.440280 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440078 2600 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.440280 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.440089 2600 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d76195a0-c393-4ae3-853e-cc21de4ffc02-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:44:23.821271 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:23.821224 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76195a0-c393-4ae3-853e-cc21de4ffc02" path="/var/lib/kubelet/pods/d76195a0-c393-4ae3-853e-cc21de4ffc02/volumes" Jul 06 23:44:27.263224 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:44:27.263192 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2kv8z" Jul 06 23:45:18.040086 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.040034 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5774649c47-jf7dg"] Jul 06 23:45:18.040993 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.040966 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76195a0-c393-4ae3-853e-cc21de4ffc02" containerName="console" Jul 06 23:45:18.041242 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.041213 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76195a0-c393-4ae3-853e-cc21de4ffc02" containerName="console" Jul 06 23:45:18.041346 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.041336 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76195a0-c393-4ae3-853e-cc21de4ffc02" containerName="console" Jul 06 23:45:18.043256 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.043241 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.045583 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045548 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 23:45:18.045583 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045548 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8dks5\"" Jul 06 23:45:18.045790 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045553 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 23:45:18.045890 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045872 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 23:45:18.045955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045891 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 23:45:18.046009 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.045974 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 23:45:18.050500 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.050476 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 23:45:18.054603 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.054585 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5774649c47-jf7dg"] Jul 06 23:45:18.132273 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132239 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-federate-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132273 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132280 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132300 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-serving-certs-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132332 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132365 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnf6\" (UniqueName: \"kubernetes.io/projected/93c7eb94-8457-4ddb-9649-78594f65bcb1-kube-api-access-lcnf6\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132385 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-metrics-client-ca\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132403 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.132709 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.132494 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233262 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233223 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233472 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233276 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-federate-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233472 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233298 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233472 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233316 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-serving-certs-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233472 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233344 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233478 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnf6\" (UniqueName: \"kubernetes.io/projected/93c7eb94-8457-4ddb-9649-78594f65bcb1-kube-api-access-lcnf6\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233530 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-metrics-client-ca\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.233654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.233560 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.234345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.234227 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-serving-certs-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.234674 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.234648 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-metrics-client-ca\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.234773 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.234652 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.236163 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.236138 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-federate-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.236242 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.236212 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.236281 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.236270 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-secret-telemeter-client\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.236325 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.236274 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c7eb94-8457-4ddb-9649-78594f65bcb1-telemeter-client-tls\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.242778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.242757 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnf6\" (UniqueName: \"kubernetes.io/projected/93c7eb94-8457-4ddb-9649-78594f65bcb1-kube-api-access-lcnf6\") pod \"telemeter-client-5774649c47-jf7dg\" (UID: \"93c7eb94-8457-4ddb-9649-78594f65bcb1\") " pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.355475 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.355375 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" Jul 06 23:45:18.493544 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.493519 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5774649c47-jf7dg"] Jul 06 23:45:18.496117 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:45:18.496089 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c7eb94_8457_4ddb_9649_78594f65bcb1.slice/crio-117b51b92c71a1f7a4229e6edffd6fa1451e698b7d4593cd61259db9562d25de WatchSource:0}: Error finding container 117b51b92c71a1f7a4229e6edffd6fa1451e698b7d4593cd61259db9562d25de: Status 404 returned error can't find the container with id 117b51b92c71a1f7a4229e6edffd6fa1451e698b7d4593cd61259db9562d25de Jul 06 23:45:18.539423 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:18.539387 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" event={"ID":"93c7eb94-8457-4ddb-9649-78594f65bcb1","Type":"ContainerStarted","Data":"117b51b92c71a1f7a4229e6edffd6fa1451e698b7d4593cd61259db9562d25de"} Jul 06 23:45:20.548066 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:20.548018 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" event={"ID":"93c7eb94-8457-4ddb-9649-78594f65bcb1","Type":"ContainerStarted","Data":"1637b7649ae70ebafbc075ed939935ce3411731b7b4f7bb4e372451b42d854b4"} Jul 06 23:45:22.557724 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:22.557687 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" event={"ID":"93c7eb94-8457-4ddb-9649-78594f65bcb1","Type":"ContainerStarted","Data":"dd47605bb4fe4c39428706e970c4aa078f588891221a7c6d9e2d37f7c5e4d9c5"} Jul 06 23:45:22.558228 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:22.557758 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" event={"ID":"93c7eb94-8457-4ddb-9649-78594f65bcb1","Type":"ContainerStarted","Data":"10c74898acfed891719eca91fd36431e9ef3776726f569adca90277f5d8ee646"} Jul 06 23:45:22.580423 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:22.580301 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5774649c47-jf7dg" podStartSLOduration=1.248879162 podStartE2EDuration="4.580278135s" totalImagesPullingTime="3.331398973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:22.578559897 +0000 UTC m=+163.279320717" watchObservedRunningTime="2026-07-06 23:45:22.580278135 +0000 UTC m=+163.281038946" Jul 06 23:45:23.429194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.429158 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:23.431424 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.431396 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.433917 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.433893 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 23:45:23.434119 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.434094 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 23:45:23.434244 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.434094 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 23:45:23.434244 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.434237 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 23:45:23.434362 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.434342 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9bqw6\"" Jul 06 23:45:23.435291 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.435275 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 23:45:23.440161 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.440143 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 23:45:23.443108 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.443089 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:23.580923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.580891 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.580923 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.580922 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjqx\" (UniqueName: \"kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.581379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.580943 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.581379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.580968 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.581379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.580982 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.581379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.581078 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.581379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.581142 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.681573 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681480 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.681573 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681532 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.681573 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681557 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjqx\" (UniqueName: \"kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.681784 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681757 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682413 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681945 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682413 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.681998 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682413 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.682089 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682413 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.682368 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682878 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.682544 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682878 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.682783 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.682878 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.682792 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.684409 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.684388 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.684525 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.684509 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.690331 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.690314 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjqx\" (UniqueName: \"kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx\") pod \"console-645d5d7c86-4ww6h\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.742476 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.742431 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:23.876066 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:23.876013 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:23.878785 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:45:23.878759 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0a8a94_1c21_4a3e_9968_eb378bdbdf23.slice/crio-9897eaa7bfaf7846ab5e59e2aa540eef37291dd8b597d78e93a10d358433b064 WatchSource:0}: Error finding container 9897eaa7bfaf7846ab5e59e2aa540eef37291dd8b597d78e93a10d358433b064: Status 404 returned error can't find the container with id 9897eaa7bfaf7846ab5e59e2aa540eef37291dd8b597d78e93a10d358433b064 Jul 06 23:45:24.566136 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:24.566099 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645d5d7c86-4ww6h" event={"ID":"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23","Type":"ContainerStarted","Data":"7a3286a0e97b80c5a9fdd6f8c786c1da9b35fc1f3443a367c433e7c38a0ed196"} Jul 06 23:45:24.566314 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:24.566147 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645d5d7c86-4ww6h" event={"ID":"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23","Type":"ContainerStarted","Data":"9897eaa7bfaf7846ab5e59e2aa540eef37291dd8b597d78e93a10d358433b064"} Jul 06 23:45:24.583254 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:24.583203 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-645d5d7c86-4ww6h" podStartSLOduration=1.583183165 podStartE2EDuration="1.583183165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:24.582292958 +0000 UTC m=+165.283053781" watchObservedRunningTime="2026-07-06 23:45:24.583183165 +0000 UTC m=+165.283943984" Jul 06 23:45:28.429238 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.429200 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:28.460128 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.460093 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd5c8fd5-gh7wc"] Jul 06 23:45:28.462167 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.462149 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.472873 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.472844 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd5c8fd5-gh7wc"] Jul 06 23:45:28.619680 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619637 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-service-ca\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619680 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619682 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-trusted-ca-bundle\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619730 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619749 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqknj\" (UniqueName: \"kubernetes.io/projected/5c181138-23a9-482e-8a1b-ff14bfcf8c46-kube-api-access-rqknj\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619783 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-oauth-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619837 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-oauth-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.619907 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.619890 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720322 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720240 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-oauth-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720322 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720277 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-oauth-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720322 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720304 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720543 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720335 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-service-ca\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720543 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720376 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-trusted-ca-bundle\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720543 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720413 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.720543 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.720442 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqknj\" (UniqueName: \"kubernetes.io/projected/5c181138-23a9-482e-8a1b-ff14bfcf8c46-kube-api-access-rqknj\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.721220 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.721120 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-oauth-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.721407 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.721304 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.721407 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.721333 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-service-ca\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.721407 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.721347 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c181138-23a9-482e-8a1b-ff14bfcf8c46-trusted-ca-bundle\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.722902 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.722880 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-oauth-config\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.723114 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.723097 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c181138-23a9-482e-8a1b-ff14bfcf8c46-console-serving-cert\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.729322 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.729303 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqknj\" (UniqueName: \"kubernetes.io/projected/5c181138-23a9-482e-8a1b-ff14bfcf8c46-kube-api-access-rqknj\") pod \"console-7dd5c8fd5-gh7wc\" (UID: \"5c181138-23a9-482e-8a1b-ff14bfcf8c46\") " pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.770994 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.770956 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:28.896862 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:28.896825 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd5c8fd5-gh7wc"] Jul 06 23:45:28.899651 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:45:28.899624 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c181138_23a9_482e_8a1b_ff14bfcf8c46.slice/crio-b361fa5b66bcbd4ca0d0ada8f2cad96a0f3fcf928b07a6aba4afcf45b2a6ff11 WatchSource:0}: Error finding container b361fa5b66bcbd4ca0d0ada8f2cad96a0f3fcf928b07a6aba4afcf45b2a6ff11: Status 404 returned error can't find the container with id b361fa5b66bcbd4ca0d0ada8f2cad96a0f3fcf928b07a6aba4afcf45b2a6ff11 Jul 06 23:45:29.584116 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:29.584075 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5c8fd5-gh7wc" event={"ID":"5c181138-23a9-482e-8a1b-ff14bfcf8c46","Type":"ContainerStarted","Data":"e63d4b0718d46dbd198007e5c9eb3e5c124d9b4ce0844cd2c980e78cba7c000e"} Jul 06 23:45:29.584505 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:29.584143 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd5c8fd5-gh7wc" event={"ID":"5c181138-23a9-482e-8a1b-ff14bfcf8c46","Type":"ContainerStarted","Data":"b361fa5b66bcbd4ca0d0ada8f2cad96a0f3fcf928b07a6aba4afcf45b2a6ff11"} Jul 06 23:45:29.601730 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:29.601653 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd5c8fd5-gh7wc" podStartSLOduration=1.6016361529999998 podStartE2EDuration="1.601636153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:45:29.601189617 +0000 UTC m=+170.301950449" watchObservedRunningTime="2026-07-06 23:45:29.601636153 +0000 UTC m=+170.302396973" Jul 06 23:45:33.743302 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:33.743203 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:38.771461 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:38.771424 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:38.771847 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:38.771487 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:38.776345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:38.776314 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:39.627616 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:39.627577 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd5c8fd5-gh7wc" Jul 06 23:45:53.449632 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.449573 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-645d5d7c86-4ww6h" podUID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" containerName="console" containerID="cri-o://7a3286a0e97b80c5a9fdd6f8c786c1da9b35fc1f3443a367c433e7c38a0ed196" gracePeriod=15 Jul 06 23:45:53.670917 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.670884 2600 generic.go:356] "Generic (PLEG): container finished" podID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" containerID="7a3286a0e97b80c5a9fdd6f8c786c1da9b35fc1f3443a367c433e7c38a0ed196" exitCode=0 Jul 06 23:45:53.671208 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.670922 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645d5d7c86-4ww6h" event={"ID":"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23","Type":"ContainerDied","Data":"7a3286a0e97b80c5a9fdd6f8c786c1da9b35fc1f3443a367c433e7c38a0ed196"} Jul 06 23:45:53.688294 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.688274 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:53.706679 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706609 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706686 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706714 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706729 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krjqx\" (UniqueName: \"kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706770 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706994 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706813 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.706994 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706843 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca\") pod \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\" (UID: \"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23\") " Jul 06 23:45:53.707122 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.706990 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:53.707122 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.707086 2600 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.707235 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.707138 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config" (OuterVolumeSpecName: "console-config") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:53.707329 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.707301 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:53.707690 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.707660 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:45:53.709217 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.709191 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:45:53.709217 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.709195 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx" (OuterVolumeSpecName: "kube-api-access-krjqx") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "kube-api-access-krjqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:45:53.709361 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.709340 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" (UID: "ca0a8a94-1c21-4a3e-9968-eb378bdbdf23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:45:53.807833 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807799 2600 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.807833 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807829 2600 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-trusted-ca-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.807833 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807839 2600 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.808081 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807847 2600 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.808081 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807855 2600 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:53.808081 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:53.807863 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krjqx\" (UniqueName: \"kubernetes.io/projected/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23-kube-api-access-krjqx\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:45:54.676669 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:54.676633 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645d5d7c86-4ww6h" event={"ID":"ca0a8a94-1c21-4a3e-9968-eb378bdbdf23","Type":"ContainerDied","Data":"9897eaa7bfaf7846ab5e59e2aa540eef37291dd8b597d78e93a10d358433b064"} Jul 06 23:45:54.676669 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:54.676664 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645d5d7c86-4ww6h" Jul 06 23:45:54.677251 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:54.676698 2600 scope.go:117] "RemoveContainer" containerID="7a3286a0e97b80c5a9fdd6f8c786c1da9b35fc1f3443a367c433e7c38a0ed196" Jul 06 23:45:54.692302 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:54.692269 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:54.696323 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:54.696299 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-645d5d7c86-4ww6h"] Jul 06 23:45:55.824211 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:45:55.824181 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" path="/var/lib/kubelet/pods/ca0a8a94-1c21-4a3e-9968-eb378bdbdf23/volumes" Jul 06 23:46:42.012497 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.012464 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm"] Jul 06 23:46:42.012919 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.012703 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" containerName="console" Jul 06 23:46:42.012919 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.012713 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" containerName="console" Jul 06 23:46:42.012919 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.012767 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0a8a94-1c21-4a3e-9968-eb378bdbdf23" containerName="console" Jul 06 23:46:42.015951 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.015932 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.018534 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.018516 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:46:42.018651 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.018582 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:46:42.019563 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.019548 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4xksb\"" Jul 06 23:46:42.024490 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.024470 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm"] Jul 06 23:46:42.063144 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.063113 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.063335 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.063153 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hsh\" (UniqueName: \"kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.063335 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.063263 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.164364 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.164321 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.164364 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.164362 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hsh\" (UniqueName: \"kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.164626 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.164482 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.164804 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.164783 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.164804 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.164794 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.173750 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.173726 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hsh\" (UniqueName: \"kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.325371 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.325283 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:46:42.454571 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.454538 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm"] Jul 06 23:46:42.457307 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:46:42.457277 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16141435_0fda_47ff_83d9_b355a70c54b6.slice/crio-908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528 WatchSource:0}: Error finding container 908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528: Status 404 returned error can't find the container with id 908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528 Jul 06 23:46:42.841724 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:42.841682 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" event={"ID":"16141435-0fda-47ff-83d9-b355a70c54b6","Type":"ContainerStarted","Data":"908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528"} Jul 06 23:46:49.865791 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:49.865749 2600 generic.go:356] "Generic (PLEG): container finished" podID="16141435-0fda-47ff-83d9-b355a70c54b6" containerID="4e48c7700d7033ba0b36cb092e8fc7d03b2833a6544644c007cd4848e9967fd3" exitCode=0 Jul 06 23:46:49.866231 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:49.865841 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" event={"ID":"16141435-0fda-47ff-83d9-b355a70c54b6","Type":"ContainerDied","Data":"4e48c7700d7033ba0b36cb092e8fc7d03b2833a6544644c007cd4848e9967fd3"} Jul 06 23:46:51.876415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:51.876376 2600 generic.go:356] "Generic (PLEG): container finished" podID="16141435-0fda-47ff-83d9-b355a70c54b6" containerID="60febd0b6fdf056acec9d0df6db5bd790f0a18ec2a7277bfb51b4f3a8c33b21f" exitCode=0 Jul 06 23:46:51.876801 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:51.876436 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" event={"ID":"16141435-0fda-47ff-83d9-b355a70c54b6","Type":"ContainerDied","Data":"60febd0b6fdf056acec9d0df6db5bd790f0a18ec2a7277bfb51b4f3a8c33b21f"} Jul 06 23:46:59.907707 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:59.907670 2600 generic.go:356] "Generic (PLEG): container finished" podID="16141435-0fda-47ff-83d9-b355a70c54b6" containerID="845aeb60a1dfaea4353c63a3a06ad0e3ca51ceadceb275984647287f18364e24" exitCode=0 Jul 06 23:46:59.908117 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:46:59.907761 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" event={"ID":"16141435-0fda-47ff-83d9-b355a70c54b6","Type":"ContainerDied","Data":"845aeb60a1dfaea4353c63a3a06ad0e3ca51ceadceb275984647287f18364e24"} Jul 06 23:47:01.073877 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.073791 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:47:01.225432 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.225350 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util\") pod \"16141435-0fda-47ff-83d9-b355a70c54b6\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " Jul 06 23:47:01.225432 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.225398 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5hsh\" (UniqueName: \"kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh\") pod \"16141435-0fda-47ff-83d9-b355a70c54b6\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " Jul 06 23:47:01.225600 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.225461 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle\") pod \"16141435-0fda-47ff-83d9-b355a70c54b6\" (UID: \"16141435-0fda-47ff-83d9-b355a70c54b6\") " Jul 06 23:47:01.226306 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.226271 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle" (OuterVolumeSpecName: "bundle") pod "16141435-0fda-47ff-83d9-b355a70c54b6" (UID: "16141435-0fda-47ff-83d9-b355a70c54b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:01.227776 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.227751 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh" (OuterVolumeSpecName: "kube-api-access-k5hsh") pod "16141435-0fda-47ff-83d9-b355a70c54b6" (UID: "16141435-0fda-47ff-83d9-b355a70c54b6"). InnerVolumeSpecName "kube-api-access-k5hsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:47:01.230460 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.230442 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util" (OuterVolumeSpecName: "util") pod "16141435-0fda-47ff-83d9-b355a70c54b6" (UID: "16141435-0fda-47ff-83d9-b355a70c54b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:01.326287 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.326251 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:01.326287 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.326280 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16141435-0fda-47ff-83d9-b355a70c54b6-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:01.326287 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.326289 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5hsh\" (UniqueName: \"kubernetes.io/projected/16141435-0fda-47ff-83d9-b355a70c54b6-kube-api-access-k5hsh\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:01.916225 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.916181 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" event={"ID":"16141435-0fda-47ff-83d9-b355a70c54b6","Type":"ContainerDied","Data":"908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528"} Jul 06 23:47:01.916401 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.916258 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="908fd903a4ab71a2b001d037640e07f1ae0dc28185dba7ad51f5610c56935528" Jul 06 23:47:01.916401 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:01.916194 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rpccm" Jul 06 23:47:04.948937 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.948904 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s"] Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949165 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="pull" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949176 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="pull" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949190 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="extract" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949195 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="extract" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949201 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="util" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949207 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="util" Jul 06 23:47:04.949328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.949246 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="16141435-0fda-47ff-83d9-b355a70c54b6" containerName="extract" Jul 06 23:47:04.951024 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.951008 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:04.953470 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.953440 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lktq5\"" Jul 06 23:47:04.953726 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.953704 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 23:47:04.953775 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.953745 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 23:47:04.966032 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:04.966010 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s"] Jul 06 23:47:05.054566 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.054531 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8bf0c9-961f-4de6-a85e-391ac22b3295-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.054727 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.054589 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jrml\" (UniqueName: \"kubernetes.io/projected/4c8bf0c9-961f-4de6-a85e-391ac22b3295-kube-api-access-5jrml\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.154941 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.154912 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8bf0c9-961f-4de6-a85e-391ac22b3295-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.155099 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.154958 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jrml\" (UniqueName: \"kubernetes.io/projected/4c8bf0c9-961f-4de6-a85e-391ac22b3295-kube-api-access-5jrml\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.155300 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.155282 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8bf0c9-961f-4de6-a85e-391ac22b3295-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.176679 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.176646 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jrml\" (UniqueName: \"kubernetes.io/projected/4c8bf0c9-961f-4de6-a85e-391ac22b3295-kube-api-access-5jrml\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzp7s\" (UID: \"4c8bf0c9-961f-4de6-a85e-391ac22b3295\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.260343 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.260316 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" Jul 06 23:47:05.401409 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.401318 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s"] Jul 06 23:47:05.403914 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:05.403883 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8bf0c9_961f_4de6_a85e_391ac22b3295.slice/crio-b317460786d20b829914a35657a24def0697fcc74c7c18b5942a98dd29cd6d1a WatchSource:0}: Error finding container b317460786d20b829914a35657a24def0697fcc74c7c18b5942a98dd29cd6d1a: Status 404 returned error can't find the container with id b317460786d20b829914a35657a24def0697fcc74c7c18b5942a98dd29cd6d1a Jul 06 23:47:05.931532 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:05.931499 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" event={"ID":"4c8bf0c9-961f-4de6-a85e-391ac22b3295","Type":"ContainerStarted","Data":"b317460786d20b829914a35657a24def0697fcc74c7c18b5942a98dd29cd6d1a"} Jul 06 23:47:07.940527 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:07.940491 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" event={"ID":"4c8bf0c9-961f-4de6-a85e-391ac22b3295","Type":"ContainerStarted","Data":"73954bd835b82fb2fe8df09ea8ad0f3bb0a5a349a5e2742d20471422a14894f1"} Jul 06 23:47:07.961749 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:07.961700 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzp7s" podStartSLOduration=2.4268067540000002 podStartE2EDuration="3.961683995s" totalImagesPullingTime="1.534877241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:07.961515015 +0000 UTC m=+268.662275831" watchObservedRunningTime="2026-07-06 23:47:07.961683995 +0000 UTC m=+268.662444816" Jul 06 23:47:09.128458 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.128428 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg"] Jul 06 23:47:09.131769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.131753 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.134668 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.134650 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4xksb\"" Jul 06 23:47:09.134855 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.134840 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:47:09.135351 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.135335 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:47:09.144449 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.144426 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg"] Jul 06 23:47:09.164002 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.163970 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l9wtk"] Jul 06 23:47:09.167123 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.167106 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.170610 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.170571 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 23:47:09.170697 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.170685 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 23:47:09.170767 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.170749 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-znwn4\"" Jul 06 23:47:09.183593 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.183566 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l9wtk"] Jul 06 23:47:09.287686 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.287653 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqgh\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-kube-api-access-mlqgh\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.287686 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.287690 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.287917 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.287717 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.287917 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.287790 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx87d\" (UniqueName: \"kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.287917 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.287856 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.389279 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389184 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.389279 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389239 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx87d\" (UniqueName: \"kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.389517 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389293 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.389517 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389433 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqgh\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-kube-api-access-mlqgh\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.389517 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389473 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.389707 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389687 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.389764 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.389728 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.400345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.400314 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.400483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.400424 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqgh\" (UniqueName: \"kubernetes.io/projected/9f9be070-8bed-42c7-9c11-8850295067bf-kube-api-access-mlqgh\") pod \"cert-manager-webhook-6486ffd997-l9wtk\" (UID: \"9f9be070-8bed-42c7-9c11-8850295067bf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.400483 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.400431 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx87d\" (UniqueName: \"kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.441164 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.441128 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:09.488556 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.488525 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:09.591245 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.591213 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg"] Jul 06 23:47:09.594760 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:09.594730 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89edb0ea_a5f5_4f58_9dd1_1e015de7c904.slice/crio-28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831 WatchSource:0}: Error finding container 28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831: Status 404 returned error can't find the container with id 28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831 Jul 06 23:47:09.632511 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.632319 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l9wtk"] Jul 06 23:47:09.635196 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:09.635168 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f9be070_8bed_42c7_9c11_8850295067bf.slice/crio-710905211a74b80cd58294dcbf62afe75987076fb3c015fad91d7f1d0fb08a85 WatchSource:0}: Error finding container 710905211a74b80cd58294dcbf62afe75987076fb3c015fad91d7f1d0fb08a85: Status 404 returned error can't find the container with id 710905211a74b80cd58294dcbf62afe75987076fb3c015fad91d7f1d0fb08a85 Jul 06 23:47:09.949766 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.949675 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" event={"ID":"9f9be070-8bed-42c7-9c11-8850295067bf","Type":"ContainerStarted","Data":"710905211a74b80cd58294dcbf62afe75987076fb3c015fad91d7f1d0fb08a85"} Jul 06 23:47:09.951095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.951043 2600 generic.go:356] "Generic (PLEG): container finished" podID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerID="437dc6f88c4feb45211cca0b394bc1c0c9497021f22e00cff408e1e2bbe8f723" exitCode=0 Jul 06 23:47:09.951095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.951083 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" event={"ID":"89edb0ea-a5f5-4f58-9dd1-1e015de7c904","Type":"ContainerDied","Data":"437dc6f88c4feb45211cca0b394bc1c0c9497021f22e00cff408e1e2bbe8f723"} Jul 06 23:47:09.951276 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:09.951134 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" event={"ID":"89edb0ea-a5f5-4f58-9dd1-1e015de7c904","Type":"ContainerStarted","Data":"28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831"} Jul 06 23:47:13.971320 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:13.971278 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" event={"ID":"9f9be070-8bed-42c7-9c11-8850295067bf","Type":"ContainerStarted","Data":"e7357273ea9b4a2224d3ac61e213c37284262d5cad6f75ff670c87af336e5b79"} Jul 06 23:47:13.971800 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:13.971352 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:13.972967 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:13.972942 2600 generic.go:356] "Generic (PLEG): container finished" podID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerID="f4eaa3436e896a78c0403648488e7f851af9bdfe31e6d7c301e83f3e6a777626" exitCode=0 Jul 06 23:47:13.973098 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:13.973026 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" event={"ID":"89edb0ea-a5f5-4f58-9dd1-1e015de7c904","Type":"ContainerDied","Data":"f4eaa3436e896a78c0403648488e7f851af9bdfe31e6d7c301e83f3e6a777626"} Jul 06 23:47:13.987155 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:13.987115 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" podStartSLOduration=1.5549473969999998 podStartE2EDuration="4.987096188s" totalImagesPullingTime="3.432148791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:13.986180125 +0000 UTC m=+274.686940958" watchObservedRunningTime="2026-07-06 23:47:13.987096188 +0000 UTC m=+274.687857008" Jul 06 23:47:14.978813 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:14.978782 2600 generic.go:356] "Generic (PLEG): container finished" podID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerID="33611c5504e9fdbfd9deb848b148d98b236438ccc803e68b708febddd8c364af" exitCode=0 Jul 06 23:47:14.979239 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:14.978872 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" event={"ID":"89edb0ea-a5f5-4f58-9dd1-1e015de7c904","Type":"ContainerDied","Data":"33611c5504e9fdbfd9deb848b148d98b236438ccc803e68b708febddd8c364af"} Jul 06 23:47:16.106944 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.106919 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:16.246719 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.246630 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx87d\" (UniqueName: \"kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d\") pod \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " Jul 06 23:47:16.246719 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.246671 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util\") pod \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " Jul 06 23:47:16.246719 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.246706 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle\") pod \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\" (UID: \"89edb0ea-a5f5-4f58-9dd1-1e015de7c904\") " Jul 06 23:47:16.247176 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.247140 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle" (OuterVolumeSpecName: "bundle") pod "89edb0ea-a5f5-4f58-9dd1-1e015de7c904" (UID: "89edb0ea-a5f5-4f58-9dd1-1e015de7c904"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:16.248895 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.248873 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d" (OuterVolumeSpecName: "kube-api-access-wx87d") pod "89edb0ea-a5f5-4f58-9dd1-1e015de7c904" (UID: "89edb0ea-a5f5-4f58-9dd1-1e015de7c904"). InnerVolumeSpecName "kube-api-access-wx87d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:47:16.251852 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.251820 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util" (OuterVolumeSpecName: "util") pod "89edb0ea-a5f5-4f58-9dd1-1e015de7c904" (UID: "89edb0ea-a5f5-4f58-9dd1-1e015de7c904"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:16.347862 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.347821 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx87d\" (UniqueName: \"kubernetes.io/projected/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-kube-api-access-wx87d\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:16.347862 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.347852 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:16.348083 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.347881 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89edb0ea-a5f5-4f58-9dd1-1e015de7c904-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:16.988690 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.988652 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" event={"ID":"89edb0ea-a5f5-4f58-9dd1-1e015de7c904","Type":"ContainerDied","Data":"28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831"} Jul 06 23:47:16.988854 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.988710 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28070cd909dedfef70f2d1b3e41c5e47fa2778bc0b182ac732ef1fe8179cb831" Jul 06 23:47:16.988854 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:16.988668 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f95ggg" Jul 06 23:47:19.981613 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:19.981580 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l9wtk" Jul 06 23:47:21.811232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811196 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9g86g"] Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811581 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="pull" Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811599 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="pull" Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811633 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="util" Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811641 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="util" Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811652 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="extract" Jul 06 23:47:21.811704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811661 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="extract" Jul 06 23:47:21.811987 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.811720 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="89edb0ea-a5f5-4f58-9dd1-1e015de7c904" containerName="extract" Jul 06 23:47:21.815352 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.815332 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:21.817862 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.817839 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nttx9\"" Jul 06 23:47:21.821842 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.821817 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9g86g"] Jul 06 23:47:21.891741 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.891711 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rjh\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-kube-api-access-62rjh\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:21.891924 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.891766 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:21.992871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.992837 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:21.993039 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:21.992899 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rjh\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-kube-api-access-62rjh\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:22.000920 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:22.000888 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:22.001093 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:22.001034 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rjh\" (UniqueName: \"kubernetes.io/projected/8e5e04e7-c7e8-4302-8d7a-424987214e0d-kube-api-access-62rjh\") pod \"cert-manager-55b4d954d5-9g86g\" (UID: \"8e5e04e7-c7e8-4302-8d7a-424987214e0d\") " pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:22.126041 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:22.125960 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9g86g" Jul 06 23:47:22.258676 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:22.258646 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9g86g"] Jul 06 23:47:22.262169 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:22.262138 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e5e04e7_c7e8_4302_8d7a_424987214e0d.slice/crio-e2a9d9c25eb6da0e3fdbb8dfb91bb8b3bfaed1acfc13bd0306ea1064a3040775 WatchSource:0}: Error finding container e2a9d9c25eb6da0e3fdbb8dfb91bb8b3bfaed1acfc13bd0306ea1064a3040775: Status 404 returned error can't find the container with id e2a9d9c25eb6da0e3fdbb8dfb91bb8b3bfaed1acfc13bd0306ea1064a3040775 Jul 06 23:47:23.017223 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:23.017191 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9g86g" event={"ID":"8e5e04e7-c7e8-4302-8d7a-424987214e0d","Type":"ContainerStarted","Data":"5dbcd0fd4f545fede12052aaada4661ae2e72d55b441426e9a1e81d54e7c86e9"} Jul 06 23:47:23.017607 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:23.017233 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9g86g" event={"ID":"8e5e04e7-c7e8-4302-8d7a-424987214e0d","Type":"ContainerStarted","Data":"e2a9d9c25eb6da0e3fdbb8dfb91bb8b3bfaed1acfc13bd0306ea1064a3040775"} Jul 06 23:47:23.035743 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:23.035695 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9g86g" podStartSLOduration=2.035677943 podStartE2EDuration="2.035677943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:23.033641007 +0000 UTC m=+283.734401819" watchObservedRunningTime="2026-07-06 23:47:23.035677943 +0000 UTC m=+283.736438763" Jul 06 23:47:28.512307 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.512278 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg"] Jul 06 23:47:28.515928 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.515906 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.518369 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.518344 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 23:47:28.518369 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.518332 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 23:47:28.518534 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.518445 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4xksb\"" Jul 06 23:47:28.524212 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.523851 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg"] Jul 06 23:47:28.539084 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.539035 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dnc\" (UniqueName: \"kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.539213 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.539101 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.539213 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.539143 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.640226 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.640194 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.640403 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.640249 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dnc\" (UniqueName: \"kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.640403 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.640272 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.640605 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.640586 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.640645 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.640608 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.649979 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.649949 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dnc\" (UniqueName: \"kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.827047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.826968 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:28.961920 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:28.961891 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg"] Jul 06 23:47:28.964428 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:28.964400 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc155f8_9ee4_458e_8762_d8084d88866d.slice/crio-9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a WatchSource:0}: Error finding container 9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a: Status 404 returned error can't find the container with id 9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a Jul 06 23:47:29.041095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:29.041065 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerStarted","Data":"3118be63c5939b6dfcee1f58614b7336f0d652534c1079aa0c0d16654b38b5ed"} Jul 06 23:47:29.041220 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:29.041125 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerStarted","Data":"9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a"} Jul 06 23:47:30.046434 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:30.046406 2600 generic.go:356] "Generic (PLEG): container finished" podID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerID="3118be63c5939b6dfcee1f58614b7336f0d652534c1079aa0c0d16654b38b5ed" exitCode=0 Jul 06 23:47:30.046808 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:30.046440 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerDied","Data":"3118be63c5939b6dfcee1f58614b7336f0d652534c1079aa0c0d16654b38b5ed"} Jul 06 23:47:31.053014 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:31.052972 2600 generic.go:356] "Generic (PLEG): container finished" podID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerID="60a32785983563a3970eba16732264c74d44edb3163f98755987ccc098ff316d" exitCode=0 Jul 06 23:47:31.053421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:31.053027 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerDied","Data":"60a32785983563a3970eba16732264c74d44edb3163f98755987ccc098ff316d"} Jul 06 23:47:32.059452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:32.059408 2600 generic.go:356] "Generic (PLEG): container finished" podID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerID="f3360fbe00689689b3dd9250b2c357707dbae3d784596c12129cf1b541509b10" exitCode=0 Jul 06 23:47:32.059844 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:32.059499 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerDied","Data":"f3360fbe00689689b3dd9250b2c357707dbae3d784596c12129cf1b541509b10"} Jul 06 23:47:33.196899 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.196877 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:33.273335 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.273302 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle\") pod \"2fc155f8-9ee4-458e-8762-d8084d88866d\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " Jul 06 23:47:33.273494 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.273368 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5dnc\" (UniqueName: \"kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc\") pod \"2fc155f8-9ee4-458e-8762-d8084d88866d\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " Jul 06 23:47:33.273494 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.273410 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util\") pod \"2fc155f8-9ee4-458e-8762-d8084d88866d\" (UID: \"2fc155f8-9ee4-458e-8762-d8084d88866d\") " Jul 06 23:47:33.274046 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.274012 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle" (OuterVolumeSpecName: "bundle") pod "2fc155f8-9ee4-458e-8762-d8084d88866d" (UID: "2fc155f8-9ee4-458e-8762-d8084d88866d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:33.275609 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.275577 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc" (OuterVolumeSpecName: "kube-api-access-c5dnc") pod "2fc155f8-9ee4-458e-8762-d8084d88866d" (UID: "2fc155f8-9ee4-458e-8762-d8084d88866d"). InnerVolumeSpecName "kube-api-access-c5dnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:47:33.278939 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.278907 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util" (OuterVolumeSpecName: "util") pod "2fc155f8-9ee4-458e-8762-d8084d88866d" (UID: "2fc155f8-9ee4-458e-8762-d8084d88866d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:47:33.374232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.374131 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:33.374232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.374175 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc155f8-9ee4-458e-8762-d8084d88866d-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:33.374232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:33.374184 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5dnc\" (UniqueName: \"kubernetes.io/projected/2fc155f8-9ee4-458e-8762-d8084d88866d-kube-api-access-c5dnc\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:47:34.069714 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:34.069681 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" event={"ID":"2fc155f8-9ee4-458e-8762-d8084d88866d","Type":"ContainerDied","Data":"9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a"} Jul 06 23:47:34.069989 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:34.069725 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f3ec0f0b562deb556228a0e7774c6e32b0777b4cc9d0db29c3881bb663bee8a" Jul 06 23:47:34.069989 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:34.069735 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkp2hg" Jul 06 23:47:39.734097 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:39.734069 2600 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 23:47:45.472241 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472207 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v"] Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472495 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="util" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472506 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="util" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472512 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="extract" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472517 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="extract" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472524 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="pull" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472529 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="pull" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.472574 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fc155f8-9ee4-458e-8762-d8084d88866d" containerName="extract" Jul 06 23:47:45.475410 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.475398 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.481830 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.481813 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 23:47:45.482326 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.482310 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-clcwx\"" Jul 06 23:47:45.482582 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.482570 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 23:47:45.483689 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.483673 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 23:47:45.483957 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.483945 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 23:47:45.499637 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.499607 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v"] Jul 06 23:47:45.570495 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.570462 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56s7t\" (UniqueName: \"kubernetes.io/projected/98477335-a950-44d1-9a07-924f1d7f6d50-kube-api-access-56s7t\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.570672 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.570515 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.570672 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.570578 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.570672 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.570619 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.570672 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.570647 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.671771 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.671729 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.671995 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.671797 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.671995 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.671846 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.671995 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.671878 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.671995 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.671935 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56s7t\" (UniqueName: \"kubernetes.io/projected/98477335-a950-44d1-9a07-924f1d7f6d50-kube-api-access-56s7t\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.672258 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.672192 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.674401 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.674369 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98477335-a950-44d1-9a07-924f1d7f6d50-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.674697 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.674670 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.674697 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.674685 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98477335-a950-44d1-9a07-924f1d7f6d50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.688042 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.688005 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56s7t\" (UniqueName: \"kubernetes.io/projected/98477335-a950-44d1-9a07-924f1d7f6d50-kube-api-access-56s7t\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-ckl8v\" (UID: \"98477335-a950-44d1-9a07-924f1d7f6d50\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.785036 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.784998 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:45.922381 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.922354 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v"] Jul 06 23:47:45.924981 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:47:45.924958 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98477335_a950_44d1_9a07_924f1d7f6d50.slice/crio-d66fc966b493c9eec52037ffd5b74c246c64baa6af6883afd9ee252243a578f4 WatchSource:0}: Error finding container d66fc966b493c9eec52037ffd5b74c246c64baa6af6883afd9ee252243a578f4: Status 404 returned error can't find the container with id d66fc966b493c9eec52037ffd5b74c246c64baa6af6883afd9ee252243a578f4 Jul 06 23:47:45.926890 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:45.926874 2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:47:46.124248 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:46.124163 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" event={"ID":"98477335-a950-44d1-9a07-924f1d7f6d50","Type":"ContainerStarted","Data":"d66fc966b493c9eec52037ffd5b74c246c64baa6af6883afd9ee252243a578f4"} Jul 06 23:47:49.140347 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:49.140264 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" event={"ID":"98477335-a950-44d1-9a07-924f1d7f6d50","Type":"ContainerStarted","Data":"7d854aa971bc3b22866c1acc0db607b6b00ecec09096239a61595ab7523d44bc"} Jul 06 23:47:50.146277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:50.146239 2600 generic.go:356] "Generic (PLEG): container finished" podID="98477335-a950-44d1-9a07-924f1d7f6d50" containerID="7d854aa971bc3b22866c1acc0db607b6b00ecec09096239a61595ab7523d44bc" exitCode=0 Jul 06 23:47:50.146277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:50.146277 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" event={"ID":"98477335-a950-44d1-9a07-924f1d7f6d50","Type":"ContainerDied","Data":"7d854aa971bc3b22866c1acc0db607b6b00ecec09096239a61595ab7523d44bc"} Jul 06 23:47:51.153624 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:51.153590 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" event={"ID":"98477335-a950-44d1-9a07-924f1d7f6d50","Type":"ContainerStarted","Data":"f904df660e5c08e57ccc21af0e9816cc07acf3a609df3bde644a4717ba938a14"} Jul 06 23:47:51.154150 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:51.153737 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:47:51.179644 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:47:51.179591 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" podStartSLOduration=1.9308737740000002 podStartE2EDuration="6.179575078s" totalImagesPullingTime="3.214263085s" totalInitContainerRuntime="1.034438219s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:51.177375623 +0000 UTC m=+311.878136443" watchObservedRunningTime="2026-07-06 23:47:51.179575078 +0000 UTC m=+311.880335899" Jul 06 23:48:02.160696 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:02.160662 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-ckl8v" Jul 06 23:48:05.152447 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.152408 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s"] Jul 06 23:48:05.155916 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.155895 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.159606 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.159576 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 23:48:05.159727 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.159616 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s27px\"" Jul 06 23:48:05.159727 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.159713 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 23:48:05.160626 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.160471 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 23:48:05.160626 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.160520 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 23:48:05.170176 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.170151 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s"] Jul 06 23:48:05.232492 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.232441 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tls-certs\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.232492 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.232490 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btstk\" (UniqueName: \"kubernetes.io/projected/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-kube-api-access-btstk\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.232775 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.232518 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tmp\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.333626 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.333592 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tls-certs\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.333811 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.333632 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btstk\" (UniqueName: \"kubernetes.io/projected/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-kube-api-access-btstk\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.333811 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.333677 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tmp\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.336363 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.336338 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tmp\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.336570 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.336550 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-tls-certs\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.344883 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.344846 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w4f8b"] Jul 06 23:48:05.347908 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.347889 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.351328 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.351301 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zsvcp\"" Jul 06 23:48:05.351505 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.351487 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 23:48:05.354015 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.353991 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btstk\" (UniqueName: \"kubernetes.io/projected/f258ffb1-d56b-4d6d-b305-d3dde20eb4e0-kube-api-access-btstk\") pod \"kube-auth-proxy-5646546ff9-mfb4s\" (UID: \"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0\") " pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.366251 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.366230 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w4f8b"] Jul 06 23:48:05.434188 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.434116 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcp8\" (UniqueName: \"kubernetes.io/projected/9408ef64-f330-4cf1-b1f0-c952f724b7c1-kube-api-access-ckcp8\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.434188 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.434170 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.467226 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.467194 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" Jul 06 23:48:05.535870 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.535463 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcp8\" (UniqueName: \"kubernetes.io/projected/9408ef64-f330-4cf1-b1f0-c952f724b7c1-kube-api-access-ckcp8\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.535870 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.535523 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.535870 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:48:05.535651 2600 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 23:48:05.535870 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:48:05.535712 2600 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert podName:9408ef64-f330-4cf1-b1f0-c952f724b7c1 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:06.035691725 +0000 UTC m=+326.736452522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert") pod "odh-model-controller-7998c67dc4-w4f8b" (UID: "9408ef64-f330-4cf1-b1f0-c952f724b7c1") : secret "odh-model-controller-webhook-cert" not found Jul 06 23:48:05.549673 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.549636 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcp8\" (UniqueName: \"kubernetes.io/projected/9408ef64-f330-4cf1-b1f0-c952f724b7c1-kube-api-access-ckcp8\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:05.607402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.607353 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s"] Jul 06 23:48:05.610779 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:48:05.610743 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf258ffb1_d56b_4d6d_b305_d3dde20eb4e0.slice/crio-421925feaa58faf8605452764be9a5fe4f0c68d2803b154739f44be4baa8295d WatchSource:0}: Error finding container 421925feaa58faf8605452764be9a5fe4f0c68d2803b154739f44be4baa8295d: Status 404 returned error can't find the container with id 421925feaa58faf8605452764be9a5fe4f0c68d2803b154739f44be4baa8295d Jul 06 23:48:05.993798 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.993753 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xct6z"] Jul 06 23:48:05.998438 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:05.998419 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.002643 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.002621 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 23:48:06.002871 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.002856 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tftlr\"" Jul 06 23:48:06.015731 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.015708 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xct6z"] Jul 06 23:48:06.040362 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.040330 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:06.042744 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.042714 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9408ef64-f330-4cf1-b1f0-c952f724b7c1-cert\") pod \"odh-model-controller-7998c67dc4-w4f8b\" (UID: \"9408ef64-f330-4cf1-b1f0-c952f724b7c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:06.141250 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.141215 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9613d86f-059f-4b71-a31a-3cc41a21b484-tls-certs\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.141419 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.141257 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7wh\" (UniqueName: \"kubernetes.io/projected/9613d86f-059f-4b71-a31a-3cc41a21b484-kube-api-access-5b7wh\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.221303 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.221271 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" event={"ID":"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0","Type":"ContainerStarted","Data":"421925feaa58faf8605452764be9a5fe4f0c68d2803b154739f44be4baa8295d"} Jul 06 23:48:06.242786 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.242749 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9613d86f-059f-4b71-a31a-3cc41a21b484-tls-certs\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.242931 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.242806 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7wh\" (UniqueName: \"kubernetes.io/projected/9613d86f-059f-4b71-a31a-3cc41a21b484-kube-api-access-5b7wh\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.245585 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.245519 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9613d86f-059f-4b71-a31a-3cc41a21b484-tls-certs\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.251324 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.251293 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7wh\" (UniqueName: \"kubernetes.io/projected/9613d86f-059f-4b71-a31a-3cc41a21b484-kube-api-access-5b7wh\") pod \"model-serving-api-54d89bd5fc-xct6z\" (UID: \"9613d86f-059f-4b71-a31a-3cc41a21b484\") " pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.264200 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.264170 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:06.309000 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.308902 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:06.429786 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.428338 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:06.432921 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.432898 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.434972 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.434927 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w4f8b"] Jul 06 23:48:06.437972 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.437894 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9djj5\"" Jul 06 23:48:06.438306 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.438288 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 23:48:06.438574 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.438559 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 23:48:06.438741 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.438728 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 23:48:06.438891 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.438877 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 23:48:06.450735 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.450429 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:06.514845 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:48:06.514816 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9613d86f_059f_4b71_a31a_3cc41a21b484.slice/crio-e13be4603eac3dca1c07eff777f008148510836ac3ed2ff2dd0bccc6c8b837e1 WatchSource:0}: Error finding container e13be4603eac3dca1c07eff777f008148510836ac3ed2ff2dd0bccc6c8b837e1: Status 404 returned error can't find the container with id e13be4603eac3dca1c07eff777f008148510836ac3ed2ff2dd0bccc6c8b837e1 Jul 06 23:48:06.524212 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.524185 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xct6z"] Jul 06 23:48:06.546149 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546113 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546326 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546164 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546326 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546256 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546326 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546287 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546498 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546358 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546498 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546383 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.546498 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.546406 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ldp\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647228 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647172 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647265 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647291 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647327 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ldp\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647387 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647419 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.647712 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.647468 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.648367 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.648309 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.657186 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.650701 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.657186 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.650977 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.657186 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.655041 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.658294 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.658208 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.664896 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.664246 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.664896 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.664839 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ldp\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp\") pod \"istiod-openshift-gateway-7574459656-845c7\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.757822 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.757784 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:06.923821 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:06.923690 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:06.926395 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:48:06.926368 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574b3424_2187_46a1_ba5e_94314efac6b4.slice/crio-b1c28222b46074daaa6adb9ad51ce84469c9a47f28a3908d355627529414bec8 WatchSource:0}: Error finding container b1c28222b46074daaa6adb9ad51ce84469c9a47f28a3908d355627529414bec8: Status 404 returned error can't find the container with id b1c28222b46074daaa6adb9ad51ce84469c9a47f28a3908d355627529414bec8 Jul 06 23:48:07.230085 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:07.230029 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" event={"ID":"9613d86f-059f-4b71-a31a-3cc41a21b484","Type":"ContainerStarted","Data":"e13be4603eac3dca1c07eff777f008148510836ac3ed2ff2dd0bccc6c8b837e1"} Jul 06 23:48:07.231914 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:07.231884 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" event={"ID":"9408ef64-f330-4cf1-b1f0-c952f724b7c1","Type":"ContainerStarted","Data":"b91607485814188bc42af4d9eb4a3c5adf9e5ddf28388b62e0992e2528a3cbbe"} Jul 06 23:48:07.233670 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:07.233646 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" event={"ID":"574b3424-2187-46a1-ba5e-94314efac6b4","Type":"ContainerStarted","Data":"b1c28222b46074daaa6adb9ad51ce84469c9a47f28a3908d355627529414bec8"} Jul 06 23:48:11.637129 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:11.636884 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:11.637129 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:11.636970 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:12.286517 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.286469 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" event={"ID":"9613d86f-059f-4b71-a31a-3cc41a21b484","Type":"ContainerStarted","Data":"16237b17a73acb4a102830c2221328183a8e0926ed03246afe7619df087ad4e3"} Jul 06 23:48:12.286725 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.286621 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:48:12.288446 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.288420 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" event={"ID":"9408ef64-f330-4cf1-b1f0-c952f724b7c1","Type":"ContainerStarted","Data":"06a8efccc52c53095c5be33555ec83a479eb2526ed2bb11eee6578c954c97658"} Jul 06 23:48:12.288576 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.288514 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:12.289943 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.289914 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" event={"ID":"f258ffb1-d56b-4d6d-b305-d3dde20eb4e0","Type":"ContainerStarted","Data":"0d83286c7144a7788b2de77e6a85421f951e514175a7ddb4fb252d49737e77ce"} Jul 06 23:48:12.291379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.291361 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" event={"ID":"574b3424-2187-46a1-ba5e-94314efac6b4","Type":"ContainerStarted","Data":"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1"} Jul 06 23:48:12.291571 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.291545 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:12.293135 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.293115 2600 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-845c7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:48:12.293215 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.293163 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:48:12.306062 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.306007 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" podStartSLOduration=2.18740772 podStartE2EDuration="7.305990127s" totalImagesPullingTime="5.118582407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:12.303314768 +0000 UTC m=+333.004075592" watchObservedRunningTime="2026-07-06 23:48:12.305990127 +0000 UTC m=+333.006750948" Jul 06 23:48:12.320575 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.320533 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" podStartSLOduration=2.074706333 podStartE2EDuration="7.320517929s" totalImagesPullingTime="5.245811596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:12.31888035 +0000 UTC m=+333.019641170" watchObservedRunningTime="2026-07-06 23:48:12.320517929 +0000 UTC m=+333.021278748" Jul 06 23:48:12.339736 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.339674 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" podStartSLOduration=1.6318412169999998 podStartE2EDuration="6.339659619s" totalImagesPullingTime="4.707818402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:12.338219659 +0000 UTC m=+333.038980493" watchObservedRunningTime="2026-07-06 23:48:12.339659619 +0000 UTC m=+333.040420439" Jul 06 23:48:12.356647 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:12.356581 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5646546ff9-mfb4s" podStartSLOduration=1.33304749 podStartE2EDuration="7.356557135s" totalImagesPullingTime="6.023509645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:12.354241643 +0000 UTC m=+333.055002463" watchObservedRunningTime="2026-07-06 23:48:12.356557135 +0000 UTC m=+333.057317956" Jul 06 23:48:13.297024 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.296993 2600 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-845c7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:48:13.297408 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.297046 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:48:13.792795 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.792759 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5"] Jul 06 23:48:13.796177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.796157 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.803526 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.803506 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xcxf9\"" Jul 06 23:48:13.834170 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.834146 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5"] Jul 06 23:48:13.916204 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916160 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztt4m\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-kube-api-access-ztt4m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916211 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916237 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916298 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916329 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916352 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916521 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916406 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916521 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916435 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26526857-690d-4a5f-88a2-b07e750f2854-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:13.916521 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:13.916469 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26526857-690d-4a5f-88a2-b07e750f2854-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.016943 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.016908 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.016943 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.016945 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017192 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.016972 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017192 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017102 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017192 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017137 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017192 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017187 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017224 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26526857-690d-4a5f-88a2-b07e750f2854-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017276 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26526857-690d-4a5f-88a2-b07e750f2854-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017332 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztt4m\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-kube-api-access-ztt4m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017402 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017366 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017454 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017612 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017545 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.017725 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.017696 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.018102 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.018075 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26526857-690d-4a5f-88a2-b07e750f2854-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.019800 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.019777 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26526857-690d-4a5f-88a2-b07e750f2854-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.019915 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.019813 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26526857-690d-4a5f-88a2-b07e750f2854-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.028773 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.028751 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztt4m\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-kube-api-access-ztt4m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.028902 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.028882 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26526857-690d-4a5f-88a2-b07e750f2854-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zdfs5\" (UID: \"26526857-690d-4a5f-88a2-b07e750f2854\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.106978 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.106892 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:14.268134 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.268101 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5"] Jul 06 23:48:14.270007 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:48:14.269982 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26526857_690d_4a5f_88a2_b07e750f2854.slice/crio-19b23db4a260e8c2793d6844719b56bfb5f31a68254dfefc76fd22f79cf1de51 WatchSource:0}: Error finding container 19b23db4a260e8c2793d6844719b56bfb5f31a68254dfefc76fd22f79cf1de51: Status 404 returned error can't find the container with id 19b23db4a260e8c2793d6844719b56bfb5f31a68254dfefc76fd22f79cf1de51 Jul 06 23:48:14.302298 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.302263 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" event={"ID":"26526857-690d-4a5f-88a2-b07e750f2854","Type":"ContainerStarted","Data":"19b23db4a260e8c2793d6844719b56bfb5f31a68254dfefc76fd22f79cf1de51"} Jul 06 23:48:14.430044 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.429963 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc"] Jul 06 23:48:14.434452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.434433 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.448080 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.448025 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc"] Jul 06 23:48:14.522723 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522689 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.522947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522731 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7z9q\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-kube-api-access-v7z9q\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.522947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522757 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.522947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522779 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.522947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522874 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.522947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522915 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/461733e4-f410-417e-a73a-71d2413609d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.523137 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.522976 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.623654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623620 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.623654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623659 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/461733e4-f410-417e-a73a-71d2413609d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.623885 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623692 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.623885 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623753 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.623885 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623778 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7z9q\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-kube-api-access-v7z9q\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.624017 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623914 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.624017 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.623962 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.624548 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.624473 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.626199 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.626176 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/461733e4-f410-417e-a73a-71d2413609d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.626199 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.626191 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.626654 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.626632 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.626728 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.626688 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/461733e4-f410-417e-a73a-71d2413609d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.637232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.637204 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7z9q\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-kube-api-access-v7z9q\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.637517 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.637497 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/461733e4-f410-417e-a73a-71d2413609d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q4hzc\" (UID: \"461733e4-f410-417e-a73a-71d2413609d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.744799 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.744763 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:14.943946 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.943915 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc"] Jul 06 23:48:14.946420 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:48:14.946389 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461733e4_f410_417e_a73a_71d2413609d4.slice/crio-0d1478bf1d5308ce5103963dbc00e306e7167f14ab0fe31c88394c5ba463f504 WatchSource:0}: Error finding container 0d1478bf1d5308ce5103963dbc00e306e7167f14ab0fe31c88394c5ba463f504: Status 404 returned error can't find the container with id 0d1478bf1d5308ce5103963dbc00e306e7167f14ab0fe31c88394c5ba463f504 Jul 06 23:48:14.950069 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.950007 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:14.950187 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:14.950115 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:15.310550 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:15.310445 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" event={"ID":"461733e4-f410-417e-a73a-71d2413609d4","Type":"ContainerStarted","Data":"4a8d5e9b5c8b0ad3027a0e2963c6834561f9459612fc5a0831efcda71720d40e"} Jul 06 23:48:15.310550 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:15.310507 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" event={"ID":"461733e4-f410-417e-a73a-71d2413609d4","Type":"ContainerStarted","Data":"0d1478bf1d5308ce5103963dbc00e306e7167f14ab0fe31c88394c5ba463f504"} Jul 06 23:48:15.310550 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:15.310551 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:15.335210 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:15.335159 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" podStartSLOduration=1.335137582 podStartE2EDuration="1.335137582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:15.334873944 +0000 UTC m=+336.035634765" watchObservedRunningTime="2026-07-06 23:48:15.335137582 +0000 UTC m=+336.035898402" Jul 06 23:48:16.298091 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:16.297447 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:16.322442 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:16.322407 2600 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-q4hzc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:48:16.322875 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:16.322465 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" podUID="461733e4-f410-417e-a73a-71d2413609d4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:48:17.265572 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:17.265534 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:17.265682 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:17.265622 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:17.265682 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:17.265668 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:48:18.332365 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:18.332329 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" event={"ID":"26526857-690d-4a5f-88a2-b07e750f2854","Type":"ContainerStarted","Data":"5305f74a8994040edf2a112ac75f2de1e48652dc79e38d808a7f991cb81c4974"} Jul 06 23:48:19.107140 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.107101 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:19.111561 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.111535 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:19.140887 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.140833 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" podStartSLOduration=3.14808912 podStartE2EDuration="6.140814651s" totalImagesPullingTime="2.992725531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:18.36776586 +0000 UTC m=+339.068526680" watchObservedRunningTime="2026-07-06 23:48:19.140814651 +0000 UTC m=+339.841575473" Jul 06 23:48:19.321960 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.321922 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q4hzc" Jul 06 23:48:19.337285 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.337261 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:19.338248 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.338230 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zdfs5" Jul 06 23:48:19.415533 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.415447 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:19.415679 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.415626 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" containerID="cri-o://d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1" gracePeriod=30 Jul 06 23:48:19.681939 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.681870 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:19.775227 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775190 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775405 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775249 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775405 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775294 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775405 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775322 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775405 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775351 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775611 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775407 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775611 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775434 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7ldp\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp\") pod \"574b3424-2187-46a1-ba5e-94314efac6b4\" (UID: \"574b3424-2187-46a1-ba5e-94314efac6b4\") " Jul 06 23:48:19.775702 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775650 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:48:19.775751 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.775730 2600 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-ca-configmap\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.777876 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.777811 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:19.778046 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.777950 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs" (OuterVolumeSpecName: "local-certs") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:48:19.778046 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.778036 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts" (OuterVolumeSpecName: "cacerts") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:19.779030 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.779002 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp" (OuterVolumeSpecName: "kube-api-access-h7ldp") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "kube-api-access-h7ldp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:48:19.779206 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.779185 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:48:19.779300 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.779282 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "574b3424-2187-46a1-ba5e-94314efac6b4" (UID: "574b3424-2187-46a1-ba5e-94314efac6b4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:48:19.876480 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876448 2600 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/574b3424-2187-46a1-ba5e-94314efac6b4-local-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.876480 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876472 2600 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-csr-dns-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.876480 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876483 2600 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-cacerts\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.876706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876492 2600 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/574b3424-2187-46a1-ba5e-94314efac6b4-istio-kubeconfig\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.876706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876501 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:19.876706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:19.876508 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7ldp\" (UniqueName: \"kubernetes.io/projected/574b3424-2187-46a1-ba5e-94314efac6b4-kube-api-access-h7ldp\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:48:20.342940 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.342902 2600 generic.go:356] "Generic (PLEG): container finished" podID="574b3424-2187-46a1-ba5e-94314efac6b4" containerID="d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1" exitCode=0 Jul 06 23:48:20.343454 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.342945 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" Jul 06 23:48:20.343454 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.342992 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" event={"ID":"574b3424-2187-46a1-ba5e-94314efac6b4","Type":"ContainerDied","Data":"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1"} Jul 06 23:48:20.343454 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.343076 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-845c7" event={"ID":"574b3424-2187-46a1-ba5e-94314efac6b4","Type":"ContainerDied","Data":"b1c28222b46074daaa6adb9ad51ce84469c9a47f28a3908d355627529414bec8"} Jul 06 23:48:20.343454 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.343105 2600 scope.go:117] "RemoveContainer" containerID="d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1" Jul 06 23:48:20.351835 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.351817 2600 scope.go:117] "RemoveContainer" containerID="d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1" Jul 06 23:48:20.352102 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:48:20.352083 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1\": container with ID starting with d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1 not found: ID does not exist" containerID="d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1" Jul 06 23:48:20.352167 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.352113 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1"} err="failed to get container status \"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1\": rpc error: code = NotFound desc = could not find container \"d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1\": container with ID starting with d933d714d3aefc10130b7243653e716245d5b3e7f2ac4b49804e91ecf343baf1 not found: ID does not exist" Jul 06 23:48:20.363913 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.363887 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:20.368335 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:20.368312 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-845c7"] Jul 06 23:48:21.822434 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:21.822397 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" path="/var/lib/kubelet/pods/574b3424-2187-46a1-ba5e-94314efac6b4/volumes" Jul 06 23:48:23.298622 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:23.298594 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w4f8b" Jul 06 23:48:23.300777 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:48:23.300756 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xct6z" Jul 06 23:49:06.259293 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.259258 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:06.259704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.259560 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" Jul 06 23:49:06.259704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.259570 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" Jul 06 23:49:06.259704 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.259640 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="574b3424-2187-46a1-ba5e-94314efac6b4" containerName="discovery" Jul 06 23:49:06.262511 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.262487 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:06.265040 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.265013 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:49:06.265958 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.265942 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:49:06.266106 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.265956 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gjd54\"" Jul 06 23:49:06.271625 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.271601 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:06.379142 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.379113 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm8gs\" (UniqueName: \"kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs\") pod \"kuadrant-operator-catalog-rc67b\" (UID: \"01f20441-f887-432e-93d6-bc3595aca3c2\") " pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:06.480626 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.480587 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm8gs\" (UniqueName: \"kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs\") pod \"kuadrant-operator-catalog-rc67b\" (UID: \"01f20441-f887-432e-93d6-bc3595aca3c2\") " pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:06.488671 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.488645 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm8gs\" (UniqueName: \"kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs\") pod \"kuadrant-operator-catalog-rc67b\" (UID: \"01f20441-f887-432e-93d6-bc3595aca3c2\") " pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:06.574537 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.574454 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:06.630447 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.630408 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:06.711568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.711539 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:06.713352 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:06.713327 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f20441_f887_432e_93d6_bc3595aca3c2.slice/crio-a1477642c480897a64c8a312ea1bc392c4ac0e96a64c97d3119db10a9a109b12 WatchSource:0}: Error finding container a1477642c480897a64c8a312ea1bc392c4ac0e96a64c97d3119db10a9a109b12: Status 404 returned error can't find the container with id a1477642c480897a64c8a312ea1bc392c4ac0e96a64c97d3119db10a9a109b12 Jul 06 23:49:06.833811 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.833726 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpl5"] Jul 06 23:49:06.838025 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.838009 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:06.844416 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.844395 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpl5"] Jul 06 23:49:06.988182 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:06.988148 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs77p\" (UniqueName: \"kubernetes.io/projected/28ca6d6f-99d8-4ab9-8318-ac7a69da7871-kube-api-access-hs77p\") pod \"kuadrant-operator-catalog-wbpl5\" (UID: \"28ca6d6f-99d8-4ab9-8318-ac7a69da7871\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:07.089528 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.089446 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs77p\" (UniqueName: \"kubernetes.io/projected/28ca6d6f-99d8-4ab9-8318-ac7a69da7871-kube-api-access-hs77p\") pod \"kuadrant-operator-catalog-wbpl5\" (UID: \"28ca6d6f-99d8-4ab9-8318-ac7a69da7871\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:07.097874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.097846 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs77p\" (UniqueName: \"kubernetes.io/projected/28ca6d6f-99d8-4ab9-8318-ac7a69da7871-kube-api-access-hs77p\") pod \"kuadrant-operator-catalog-wbpl5\" (UID: \"28ca6d6f-99d8-4ab9-8318-ac7a69da7871\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:07.148311 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.148276 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:07.297639 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.297606 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpl5"] Jul 06 23:49:07.374281 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:07.374214 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ca6d6f_99d8_4ab9_8318_ac7a69da7871.slice/crio-16c5fc8cbf6384217034ee21a7911b90025f64eeb04a710bbcb0c5bfc290e5de WatchSource:0}: Error finding container 16c5fc8cbf6384217034ee21a7911b90025f64eeb04a710bbcb0c5bfc290e5de: Status 404 returned error can't find the container with id 16c5fc8cbf6384217034ee21a7911b90025f64eeb04a710bbcb0c5bfc290e5de Jul 06 23:49:07.562944 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.562904 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" event={"ID":"28ca6d6f-99d8-4ab9-8318-ac7a69da7871","Type":"ContainerStarted","Data":"16c5fc8cbf6384217034ee21a7911b90025f64eeb04a710bbcb0c5bfc290e5de"} Jul 06 23:49:07.564035 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:07.564006 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" event={"ID":"01f20441-f887-432e-93d6-bc3595aca3c2","Type":"ContainerStarted","Data":"a1477642c480897a64c8a312ea1bc392c4ac0e96a64c97d3119db10a9a109b12"} Jul 06 23:49:09.575709 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.575668 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" event={"ID":"28ca6d6f-99d8-4ab9-8318-ac7a69da7871","Type":"ContainerStarted","Data":"ecf79453fd549e24c26be76ca9132c6da4681347a15fe2a1b8c555b356460006"} Jul 06 23:49:09.577188 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.577167 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" event={"ID":"01f20441-f887-432e-93d6-bc3595aca3c2","Type":"ContainerStarted","Data":"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d"} Jul 06 23:49:09.577303 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.577243 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" podUID="01f20441-f887-432e-93d6-bc3595aca3c2" containerName="registry-server" containerID="cri-o://f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d" gracePeriod=2 Jul 06 23:49:09.593422 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.593375 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" podStartSLOduration=2.064139619 podStartE2EDuration="3.593355544s" totalImagesPullingTime="1.529215925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:09.590316371 +0000 UTC m=+390.291077207" watchObservedRunningTime="2026-07-06 23:49:09.593355544 +0000 UTC m=+390.294116365" Jul 06 23:49:09.604324 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.604277 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" podStartSLOduration=1.4168591959999999 podStartE2EDuration="3.604261016s" totalImagesPullingTime="2.18740182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:09.603643521 +0000 UTC m=+390.304404341" watchObservedRunningTime="2026-07-06 23:49:09.604261016 +0000 UTC m=+390.305021837" Jul 06 23:49:09.824120 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:09.824091 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:10.013999 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.013973 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm8gs\" (UniqueName: \"kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs\") pod \"01f20441-f887-432e-93d6-bc3595aca3c2\" (UID: \"01f20441-f887-432e-93d6-bc3595aca3c2\") " Jul 06 23:49:10.016275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.016251 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs" (OuterVolumeSpecName: "kube-api-access-jm8gs") pod "01f20441-f887-432e-93d6-bc3595aca3c2" (UID: "01f20441-f887-432e-93d6-bc3595aca3c2"). InnerVolumeSpecName "kube-api-access-jm8gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:10.115140 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.115111 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm8gs\" (UniqueName: \"kubernetes.io/projected/01f20441-f887-432e-93d6-bc3595aca3c2-kube-api-access-jm8gs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:10.583393 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.583361 2600 generic.go:356] "Generic (PLEG): container finished" podID="01f20441-f887-432e-93d6-bc3595aca3c2" containerID="f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d" exitCode=0 Jul 06 23:49:10.583874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.583400 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" Jul 06 23:49:10.583874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.583438 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" event={"ID":"01f20441-f887-432e-93d6-bc3595aca3c2","Type":"ContainerDied","Data":"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d"} Jul 06 23:49:10.583874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.583480 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rc67b" event={"ID":"01f20441-f887-432e-93d6-bc3595aca3c2","Type":"ContainerDied","Data":"a1477642c480897a64c8a312ea1bc392c4ac0e96a64c97d3119db10a9a109b12"} Jul 06 23:49:10.583874 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.583503 2600 scope.go:117] "RemoveContainer" containerID="f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d" Jul 06 23:49:10.592914 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.592895 2600 scope.go:117] "RemoveContainer" containerID="f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d" Jul 06 23:49:10.593172 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:49:10.593154 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d\": container with ID starting with f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d not found: ID does not exist" containerID="f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d" Jul 06 23:49:10.593243 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.593179 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d"} err="failed to get container status \"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d\": rpc error: code = NotFound desc = could not find container \"f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d\": container with ID starting with f98540d6f61e4c65b9c6cfaec4b867082b16196b22e2cb83fd7d6c0e44790e5d not found: ID does not exist" Jul 06 23:49:10.603636 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.603615 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:10.609297 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:10.609275 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rc67b"] Jul 06 23:49:11.822781 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:11.822746 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f20441-f887-432e-93d6-bc3595aca3c2" path="/var/lib/kubelet/pods/01f20441-f887-432e-93d6-bc3595aca3c2/volumes" Jul 06 23:49:17.149368 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:17.149331 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:17.149769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:17.149574 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:17.172382 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:17.172356 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:17.637618 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:17.637594 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wbpl5" Jul 06 23:49:21.865599 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.865561 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl"] Jul 06 23:49:21.865968 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.865877 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f20441-f887-432e-93d6-bc3595aca3c2" containerName="registry-server" Jul 06 23:49:21.865968 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.865888 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f20441-f887-432e-93d6-bc3595aca3c2" containerName="registry-server" Jul 06 23:49:21.865968 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.865943 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f20441-f887-432e-93d6-bc3595aca3c2" containerName="registry-server" Jul 06 23:49:21.870344 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.870328 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:21.872771 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.872750 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v84bn\"" Jul 06 23:49:21.877575 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.877555 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl"] Jul 06 23:49:21.900273 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.900238 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8q5w\" (UniqueName: \"kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:21.900273 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.900277 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:21.900492 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:21.900389 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.001754 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.001708 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.001971 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.001945 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8q5w\" (UniqueName: \"kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.002095 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.001996 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.002161 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.002131 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.002388 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.002360 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.010340 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.010316 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8q5w\" (UniqueName: \"kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.179975 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.179893 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:22.268684 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.268642 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb"] Jul 06 23:49:22.276668 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.276648 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.278403 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.278378 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb"] Jul 06 23:49:22.304349 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.304322 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wznrq\" (UniqueName: \"kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.304495 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.304359 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.304495 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.304390 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.319153 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.319130 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl"] Jul 06 23:49:22.321239 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:22.321204 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad6441b_6ddd_4689_b55a_777544a3b6f0.slice/crio-b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14 WatchSource:0}: Error finding container b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14: Status 404 returned error can't find the container with id b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14 Jul 06 23:49:22.405387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.405347 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wznrq\" (UniqueName: \"kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.405387 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.405393 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.405649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.405427 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.405803 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.405782 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.405867 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.405814 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.413790 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.413762 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wznrq\" (UniqueName: \"kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.595478 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.595439 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:22.641414 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.641383 2600 generic.go:356] "Generic (PLEG): container finished" podID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerID="1dcc6c3e6e8b97c4d2cabb9f440cd3949773cfd7e0a24f64d472f908d288290e" exitCode=0 Jul 06 23:49:22.641601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.641423 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" event={"ID":"cad6441b-6ddd-4689-b55a-777544a3b6f0","Type":"ContainerDied","Data":"1dcc6c3e6e8b97c4d2cabb9f440cd3949773cfd7e0a24f64d472f908d288290e"} Jul 06 23:49:22.641601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.641458 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" event={"ID":"cad6441b-6ddd-4689-b55a-777544a3b6f0","Type":"ContainerStarted","Data":"b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14"} Jul 06 23:49:22.672379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.672347 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp"] Jul 06 23:49:22.677123 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.677099 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.687992 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.687962 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp"] Jul 06 23:49:22.707597 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.707569 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.707759 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.707649 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4b6p\" (UniqueName: \"kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.707759 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.707695 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.732823 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.732798 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb"] Jul 06 23:49:22.735242 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:22.735215 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1592ae0f_a5af_4d68_87d3_48a17389fddf.slice/crio-282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2 WatchSource:0}: Error finding container 282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2: Status 404 returned error can't find the container with id 282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2 Jul 06 23:49:22.808530 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.808507 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.808650 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.808557 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4b6p\" (UniqueName: \"kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.808650 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.808587 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.808988 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.808969 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.809043 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.808970 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.816641 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.816621 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4b6p\" (UniqueName: \"kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:22.989910 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:22.989874 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:23.075947 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.075917 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7"] Jul 06 23:49:23.080616 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.080592 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.089525 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.089502 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7"] Jul 06 23:49:23.111379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.111344 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.111379 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.111384 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.111590 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.111507 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbgnm\" (UniqueName: \"kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.130236 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.130214 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp"] Jul 06 23:49:23.132170 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:23.132143 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f89d8a0_60b2_4a3f_8609_f3c1e9179738.slice/crio-6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71 WatchSource:0}: Error finding container 6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71: Status 404 returned error can't find the container with id 6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71 Jul 06 23:49:23.212745 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.212716 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbgnm\" (UniqueName: \"kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.212897 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.212767 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.212897 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.212790 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.213166 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.213147 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.213166 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.213154 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.223635 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.223608 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbgnm\" (UniqueName: \"kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.392013 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.391974 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:23.557299 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.557277 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7"] Jul 06 23:49:23.576848 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:23.576820 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49a60e6_9bbb_4fe3_ab05_c7f6cf9b3f02.slice/crio-87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad WatchSource:0}: Error finding container 87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad: Status 404 returned error can't find the container with id 87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad Jul 06 23:49:23.649390 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.649358 2600 generic.go:356] "Generic (PLEG): container finished" podID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerID="2ac2d3cba0ac7791457af86eae0467661fbbc7b94e268364a7e3b2edb2152286" exitCode=0 Jul 06 23:49:23.649553 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.649446 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" event={"ID":"cad6441b-6ddd-4689-b55a-777544a3b6f0","Type":"ContainerDied","Data":"2ac2d3cba0ac7791457af86eae0467661fbbc7b94e268364a7e3b2edb2152286"} Jul 06 23:49:23.651191 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.651160 2600 generic.go:356] "Generic (PLEG): container finished" podID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerID="fdf40c1820e297720fe85b430b3e08ff54f3863defa59eb61dfcc6131997ebf1" exitCode=0 Jul 06 23:49:23.651306 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.651265 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" event={"ID":"1f89d8a0-60b2-4a3f-8609-f3c1e9179738","Type":"ContainerDied","Data":"fdf40c1820e297720fe85b430b3e08ff54f3863defa59eb61dfcc6131997ebf1"} Jul 06 23:49:23.651383 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.651314 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" event={"ID":"1f89d8a0-60b2-4a3f-8609-f3c1e9179738","Type":"ContainerStarted","Data":"6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71"} Jul 06 23:49:23.652935 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.652914 2600 generic.go:356] "Generic (PLEG): container finished" podID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerID="5e13abb608a956c25dd234dd2e8de01fec82411f7f3d9b23cb211f5375988974" exitCode=0 Jul 06 23:49:23.653069 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.652992 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" event={"ID":"1592ae0f-a5af-4d68-87d3-48a17389fddf","Type":"ContainerDied","Data":"5e13abb608a956c25dd234dd2e8de01fec82411f7f3d9b23cb211f5375988974"} Jul 06 23:49:23.653069 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.653022 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" event={"ID":"1592ae0f-a5af-4d68-87d3-48a17389fddf","Type":"ContainerStarted","Data":"282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2"} Jul 06 23:49:23.655209 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.655192 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerStarted","Data":"807a5d666e43259b4394190f87f74c01a87ff0a5211b189ee1a0c49d62293f8d"} Jul 06 23:49:23.655292 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:23.655221 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerStarted","Data":"87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad"} Jul 06 23:49:24.661194 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.661112 2600 generic.go:356] "Generic (PLEG): container finished" podID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerID="807a5d666e43259b4394190f87f74c01a87ff0a5211b189ee1a0c49d62293f8d" exitCode=0 Jul 06 23:49:24.661610 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.661198 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerDied","Data":"807a5d666e43259b4394190f87f74c01a87ff0a5211b189ee1a0c49d62293f8d"} Jul 06 23:49:24.663649 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.663624 2600 generic.go:356] "Generic (PLEG): container finished" podID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerID="21230e1f27e696c418fc4da02ffb401edffd399249fd056fbd55dfefe3007c70" exitCode=0 Jul 06 23:49:24.663725 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.663684 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" event={"ID":"cad6441b-6ddd-4689-b55a-777544a3b6f0","Type":"ContainerDied","Data":"21230e1f27e696c418fc4da02ffb401edffd399249fd056fbd55dfefe3007c70"} Jul 06 23:49:24.665548 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.665529 2600 generic.go:356] "Generic (PLEG): container finished" podID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerID="23db93596d4aef276356f058a0d124dba3309f1111cfb4b964a78d5b4c0264f8" exitCode=0 Jul 06 23:49:24.665636 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.665614 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" event={"ID":"1f89d8a0-60b2-4a3f-8609-f3c1e9179738","Type":"ContainerDied","Data":"23db93596d4aef276356f058a0d124dba3309f1111cfb4b964a78d5b4c0264f8"} Jul 06 23:49:24.667571 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.667550 2600 generic.go:356] "Generic (PLEG): container finished" podID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerID="ff06ef5988204276b6188ecad94f8fbb4eacec420f2abb8f32fec659e8a21150" exitCode=0 Jul 06 23:49:24.667659 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:24.667586 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" event={"ID":"1592ae0f-a5af-4d68-87d3-48a17389fddf","Type":"ContainerDied","Data":"ff06ef5988204276b6188ecad94f8fbb4eacec420f2abb8f32fec659e8a21150"} Jul 06 23:49:25.674399 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.674319 2600 generic.go:356] "Generic (PLEG): container finished" podID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerID="5cb4f198cf1b7bfa820cf057a6da1ce4c5b3a7d18f0ecc13ac8521643c1e8135" exitCode=0 Jul 06 23:49:25.674818 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.674413 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerDied","Data":"5cb4f198cf1b7bfa820cf057a6da1ce4c5b3a7d18f0ecc13ac8521643c1e8135"} Jul 06 23:49:25.676815 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.676795 2600 generic.go:356] "Generic (PLEG): container finished" podID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerID="bbdc82851fd1a4491f61eae377dad3f0f3f9501dafba099b7a6f75691ce32171" exitCode=0 Jul 06 23:49:25.676911 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.676875 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" event={"ID":"1f89d8a0-60b2-4a3f-8609-f3c1e9179738","Type":"ContainerDied","Data":"bbdc82851fd1a4491f61eae377dad3f0f3f9501dafba099b7a6f75691ce32171"} Jul 06 23:49:25.679022 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.679002 2600 generic.go:356] "Generic (PLEG): container finished" podID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerID="7eb4160a744784af3fdfde55cca78b6a85b6c953af885427fc3780ac1c73846e" exitCode=0 Jul 06 23:49:25.679123 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.679092 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" event={"ID":"1592ae0f-a5af-4d68-87d3-48a17389fddf","Type":"ContainerDied","Data":"7eb4160a744784af3fdfde55cca78b6a85b6c953af885427fc3780ac1c73846e"} Jul 06 23:49:25.810141 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.810119 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:25.838155 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.838130 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util\") pod \"cad6441b-6ddd-4689-b55a-777544a3b6f0\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " Jul 06 23:49:25.838303 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.838187 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle\") pod \"cad6441b-6ddd-4689-b55a-777544a3b6f0\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " Jul 06 23:49:25.838303 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.838213 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8q5w\" (UniqueName: \"kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w\") pod \"cad6441b-6ddd-4689-b55a-777544a3b6f0\" (UID: \"cad6441b-6ddd-4689-b55a-777544a3b6f0\") " Jul 06 23:49:25.838814 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.838788 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle" (OuterVolumeSpecName: "bundle") pod "cad6441b-6ddd-4689-b55a-777544a3b6f0" (UID: "cad6441b-6ddd-4689-b55a-777544a3b6f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:25.840399 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.840379 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w" (OuterVolumeSpecName: "kube-api-access-j8q5w") pod "cad6441b-6ddd-4689-b55a-777544a3b6f0" (UID: "cad6441b-6ddd-4689-b55a-777544a3b6f0"). InnerVolumeSpecName "kube-api-access-j8q5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:25.843868 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.843845 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util" (OuterVolumeSpecName: "util") pod "cad6441b-6ddd-4689-b55a-777544a3b6f0" (UID: "cad6441b-6ddd-4689-b55a-777544a3b6f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:25.939601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.939506 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:25.939601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.939540 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8q5w\" (UniqueName: \"kubernetes.io/projected/cad6441b-6ddd-4689-b55a-777544a3b6f0-kube-api-access-j8q5w\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:25.939601 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:25.939556 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad6441b-6ddd-4689-b55a-777544a3b6f0-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:26.685784 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.685747 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" event={"ID":"cad6441b-6ddd-4689-b55a-777544a3b6f0","Type":"ContainerDied","Data":"b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14"} Jul 06 23:49:26.686219 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.685798 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2619ec27d8283fc9fad4bed20d3f0b8bbebd10f661a0ddd1dd4709339a81f14" Jul 06 23:49:26.686219 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.685755 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl" Jul 06 23:49:26.688002 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.687977 2600 generic.go:356] "Generic (PLEG): container finished" podID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerID="b97a9d32aa1a93d496606e578ea4e5a1a98a1d441613ac1c0e3f3990412ace4e" exitCode=0 Jul 06 23:49:26.688141 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.688040 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerDied","Data":"b97a9d32aa1a93d496606e578ea4e5a1a98a1d441613ac1c0e3f3990412ace4e"} Jul 06 23:49:26.822279 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.822259 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:26.847415 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.847386 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wznrq\" (UniqueName: \"kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq\") pod \"1592ae0f-a5af-4d68-87d3-48a17389fddf\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " Jul 06 23:49:26.847577 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.847469 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle\") pod \"1592ae0f-a5af-4d68-87d3-48a17389fddf\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " Jul 06 23:49:26.847577 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.847530 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util\") pod \"1592ae0f-a5af-4d68-87d3-48a17389fddf\" (UID: \"1592ae0f-a5af-4d68-87d3-48a17389fddf\") " Jul 06 23:49:26.848830 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.848798 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle" (OuterVolumeSpecName: "bundle") pod "1592ae0f-a5af-4d68-87d3-48a17389fddf" (UID: "1592ae0f-a5af-4d68-87d3-48a17389fddf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:26.849765 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.849741 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq" (OuterVolumeSpecName: "kube-api-access-wznrq") pod "1592ae0f-a5af-4d68-87d3-48a17389fddf" (UID: "1592ae0f-a5af-4d68-87d3-48a17389fddf"). InnerVolumeSpecName "kube-api-access-wznrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:26.855968 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.855943 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util" (OuterVolumeSpecName: "util") pod "1592ae0f-a5af-4d68-87d3-48a17389fddf" (UID: "1592ae0f-a5af-4d68-87d3-48a17389fddf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:26.862141 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.862121 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:26.948957 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.948864 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle\") pod \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " Jul 06 23:49:26.949156 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.948969 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4b6p\" (UniqueName: \"kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p\") pod \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " Jul 06 23:49:26.949156 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.949012 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util\") pod \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\" (UID: \"1f89d8a0-60b2-4a3f-8609-f3c1e9179738\") " Jul 06 23:49:26.949277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.949220 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:26.949277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.949230 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592ae0f-a5af-4d68-87d3-48a17389fddf-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:26.949277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.949252 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wznrq\" (UniqueName: \"kubernetes.io/projected/1592ae0f-a5af-4d68-87d3-48a17389fddf-kube-api-access-wznrq\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:26.949600 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.949578 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle" (OuterVolumeSpecName: "bundle") pod "1f89d8a0-60b2-4a3f-8609-f3c1e9179738" (UID: "1f89d8a0-60b2-4a3f-8609-f3c1e9179738"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:26.951265 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.951232 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p" (OuterVolumeSpecName: "kube-api-access-p4b6p") pod "1f89d8a0-60b2-4a3f-8609-f3c1e9179738" (UID: "1f89d8a0-60b2-4a3f-8609-f3c1e9179738"). InnerVolumeSpecName "kube-api-access-p4b6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:26.954312 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:26.954282 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util" (OuterVolumeSpecName: "util") pod "1f89d8a0-60b2-4a3f-8609-f3c1e9179738" (UID: "1f89d8a0-60b2-4a3f-8609-f3c1e9179738"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:27.049785 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.049755 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4b6p\" (UniqueName: \"kubernetes.io/projected/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-kube-api-access-p4b6p\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:27.049785 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.049781 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:27.049785 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.049790 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f89d8a0-60b2-4a3f-8609-f3c1e9179738-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:27.694988 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.694962 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" Jul 06 23:49:27.694988 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.694978 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb" event={"ID":"1592ae0f-a5af-4d68-87d3-48a17389fddf","Type":"ContainerDied","Data":"282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2"} Jul 06 23:49:27.695460 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.695024 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="282858372e76bee866c3f968fe804200057990dc7354cdb69ec3df427a5475b2" Jul 06 23:49:27.696903 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.696880 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" Jul 06 23:49:27.696903 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.696894 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp" event={"ID":"1f89d8a0-60b2-4a3f-8609-f3c1e9179738","Type":"ContainerDied","Data":"6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71"} Jul 06 23:49:27.697047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.696934 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b31f23f28b62c5e81ec175790bbaee7e4fe771c1feaa017eb9103ec5f265c71" Jul 06 23:49:27.830245 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.830221 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:27.854848 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.854815 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util\") pod \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " Jul 06 23:49:27.855003 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.854884 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle\") pod \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " Jul 06 23:49:27.855003 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.854914 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbgnm\" (UniqueName: \"kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm\") pod \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\" (UID: \"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02\") " Jul 06 23:49:27.855462 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.855432 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle" (OuterVolumeSpecName: "bundle") pod "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" (UID: "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:27.857278 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.857250 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm" (OuterVolumeSpecName: "kube-api-access-dbgnm") pod "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" (UID: "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02"). InnerVolumeSpecName "kube-api-access-dbgnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:49:27.860213 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.860181 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util" (OuterVolumeSpecName: "util") pod "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" (UID: "f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:49:27.956048 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.955955 2600 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:27.956048 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.955986 2600 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:27.956048 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:27.955995 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbgnm\" (UniqueName: \"kubernetes.io/projected/f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02-kube-api-access-dbgnm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:49:28.703380 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:28.703353 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" Jul 06 23:49:28.703380 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:28.703371 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7" event={"ID":"f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02","Type":"ContainerDied","Data":"87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad"} Jul 06 23:49:28.703778 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:28.703411 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87f6d7ed043f882625076c761e902c795cece6cb19771478a138b532a2bd50ad" Jul 06 23:49:39.758092 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758036 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c"] Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758384 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758399 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758416 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="pull" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758426 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="pull" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758441 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758447 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758455 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758460 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758470 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758475 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="extract" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758483 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758488 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758496 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758500 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="util" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758506 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="pull" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758514 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="pull" Jul 06 23:49:39.758515 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758524 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="util" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758532 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="util" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758538 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="pull" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758543 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="pull" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758552 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="extract" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758557 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="extract" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758565 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="pull" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758569 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="pull" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758621 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad6441b-6ddd-4689-b55a-777544a3b6f0" containerName="extract" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758627 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f89d8a0-60b2-4a3f-8609-f3c1e9179738" containerName="extract" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758634 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02" containerName="extract" Jul 06 23:49:39.759160 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.758640 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="1592ae0f-a5af-4d68-87d3-48a17389fddf" containerName="extract" Jul 06 23:49:39.768397 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.768360 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.771018 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.771000 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rbcjd\"" Jul 06 23:49:39.776600 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.776562 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c"] Jul 06 23:49:39.867794 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.867764 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.867980 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.867823 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqjv\" (UniqueName: \"kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.968767 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.968724 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.968938 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.968811 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqjv\" (UniqueName: \"kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.969185 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.969163 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:39.982482 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:39.982449 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqjv\" (UniqueName: \"kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:40.079939 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:40.079853 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:40.226393 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:40.226367 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c"] Jul 06 23:49:40.228946 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:40.228919 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9359950_20d2_42ad_ba9a_47adbc054f88.slice/crio-666d2c4f3d6242602ceb9dfd6c3d3780ebb3d3e00c49cc40c96f920f2f86285c WatchSource:0}: Error finding container 666d2c4f3d6242602ceb9dfd6c3d3780ebb3d3e00c49cc40c96f920f2f86285c: Status 404 returned error can't find the container with id 666d2c4f3d6242602ceb9dfd6c3d3780ebb3d3e00c49cc40c96f920f2f86285c Jul 06 23:49:40.760630 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:40.760582 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" event={"ID":"d9359950-20d2-42ad-ba9a-47adbc054f88","Type":"ContainerStarted","Data":"666d2c4f3d6242602ceb9dfd6c3d3780ebb3d3e00c49cc40c96f920f2f86285c"} Jul 06 23:49:42.410788 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.410749 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gshxv"] Jul 06 23:49:42.414516 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.414492 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:42.423750 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.423729 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-986v8\"" Jul 06 23:49:42.472491 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.472455 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gshxv"] Jul 06 23:49:42.490511 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.490479 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt62x\" (UniqueName: \"kubernetes.io/projected/f889fdee-e850-4f1c-ad8d-58f9f30a00f8-kube-api-access-pt62x\") pod \"authorino-operator-75cc8d5cb7-gshxv\" (UID: \"f889fdee-e850-4f1c-ad8d-58f9f30a00f8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:42.597232 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.591859 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt62x\" (UniqueName: \"kubernetes.io/projected/f889fdee-e850-4f1c-ad8d-58f9f30a00f8-kube-api-access-pt62x\") pod \"authorino-operator-75cc8d5cb7-gshxv\" (UID: \"f889fdee-e850-4f1c-ad8d-58f9f30a00f8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:42.603313 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.603282 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt62x\" (UniqueName: \"kubernetes.io/projected/f889fdee-e850-4f1c-ad8d-58f9f30a00f8-kube-api-access-pt62x\") pod \"authorino-operator-75cc8d5cb7-gshxv\" (UID: \"f889fdee-e850-4f1c-ad8d-58f9f30a00f8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:42.725607 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.725445 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:42.898087 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:42.898044 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gshxv"] Jul 06 23:49:42.900694 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:49:42.900655 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf889fdee_e850_4f1c_ad8d_58f9f30a00f8.slice/crio-bee9b26ad85a24247b3943b2877d1ce34580b4d64cc5505c17f5934149775923 WatchSource:0}: Error finding container bee9b26ad85a24247b3943b2877d1ce34580b4d64cc5505c17f5934149775923: Status 404 returned error can't find the container with id bee9b26ad85a24247b3943b2877d1ce34580b4d64cc5505c17f5934149775923 Jul 06 23:49:43.781584 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:43.781547 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" event={"ID":"f889fdee-e850-4f1c-ad8d-58f9f30a00f8","Type":"ContainerStarted","Data":"bee9b26ad85a24247b3943b2877d1ce34580b4d64cc5505c17f5934149775923"} Jul 06 23:49:46.803860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.803812 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" event={"ID":"d9359950-20d2-42ad-ba9a-47adbc054f88","Type":"ContainerStarted","Data":"5e187a6eb4e77a650101c6d29e070c9b240141e3acdceef5ca1842bf830f28f5"} Jul 06 23:49:46.804345 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.803896 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:46.805429 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.805404 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" event={"ID":"f889fdee-e850-4f1c-ad8d-58f9f30a00f8","Type":"ContainerStarted","Data":"56defe8c8c13b94b638dbd67d659b1bcdf59ce67f459db4fb7f539c33a39bc39"} Jul 06 23:49:46.805560 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.805531 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:46.823976 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.823916 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" podStartSLOduration=1.439680412 podStartE2EDuration="7.823900305s" totalImagesPullingTime="6.384219893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:46.822023482 +0000 UTC m=+427.522784346" watchObservedRunningTime="2026-07-06 23:49:46.823900305 +0000 UTC m=+427.524661206" Jul 06 23:49:46.841492 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:46.841441 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" podStartSLOduration=1.1397845 podStartE2EDuration="4.841424175s" totalImagesPullingTime="3.701639675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:46.840675604 +0000 UTC m=+427.541436451" watchObservedRunningTime="2026-07-06 23:49:46.841424175 +0000 UTC m=+427.542184995" Jul 06 23:49:57.812226 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:57.812189 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gshxv" Jul 06 23:49:57.812595 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:57.812280 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:59.657043 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.656997 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c"] Jul 06 23:49:59.657529 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.657303 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" containerName="manager" containerID="cri-o://5e187a6eb4e77a650101c6d29e070c9b240141e3acdceef5ca1842bf830f28f5" gracePeriod=2 Jul 06 23:49:59.679346 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.679315 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c"] Jul 06 23:49:59.686815 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:49:59.686771 2600 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d9359950-20d2-42ad-ba9a-47adbc054f88\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:59.708540 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.708510 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:49:59.708971 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.708956 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" containerName="manager" Jul 06 23:49:59.709026 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.708975 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" containerName="manager" Jul 06 23:49:59.709100 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.709086 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" containerName="manager" Jul 06 23:49:59.712452 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.712427 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.734944 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.734917 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:49:59.756885 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:49:59.756848 2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" is forbidden: User \"system:node:ip-10-0-132-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-64.ec2.internal' and this object" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:59.821094 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:49:59.821017 2600 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vfs9c\" is forbidden: User \"system:node:ip-10-0-132-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-64.ec2.internal' and this object" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:59.850631 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.850601 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtw4\" (UniqueName: \"kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.850788 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.850638 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.873474 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.873443 2600 generic.go:356] "Generic (PLEG): container finished" podID="d9359950-20d2-42ad-ba9a-47adbc054f88" containerID="5e187a6eb4e77a650101c6d29e070c9b240141e3acdceef5ca1842bf830f28f5" exitCode=0 Jul 06 23:49:59.904285 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.904263 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:49:59.951362 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.951275 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtw4\" (UniqueName: \"kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.951362 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.951318 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.951675 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.951661 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:49:59.959936 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:49:59.959909 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtw4\" (UniqueName: \"kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g65hz\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:00.040451 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.040420 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:00.052581 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.052552 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume\") pod \"d9359950-20d2-42ad-ba9a-47adbc054f88\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " Jul 06 23:50:00.052665 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.052650 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wqjv\" (UniqueName: \"kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv\") pod \"d9359950-20d2-42ad-ba9a-47adbc054f88\" (UID: \"d9359950-20d2-42ad-ba9a-47adbc054f88\") " Jul 06 23:50:00.053119 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.053095 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9359950-20d2-42ad-ba9a-47adbc054f88" (UID: "d9359950-20d2-42ad-ba9a-47adbc054f88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:50:00.055020 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.054994 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv" (OuterVolumeSpecName: "kube-api-access-8wqjv") pod "d9359950-20d2-42ad-ba9a-47adbc054f88" (UID: "d9359950-20d2-42ad-ba9a-47adbc054f88"). InnerVolumeSpecName "kube-api-access-8wqjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:50:00.153609 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.153577 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wqjv\" (UniqueName: \"kubernetes.io/projected/d9359950-20d2-42ad-ba9a-47adbc054f88-kube-api-access-8wqjv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:50:00.153609 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.153611 2600 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9359950-20d2-42ad-ba9a-47adbc054f88-extensions-socket-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:50:00.186120 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.186084 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:50:00.189859 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:50:00.189833 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd09ee3_b4ce_4ffa_81bb_2520501370a2.slice/crio-e8f8a6a216d518d79a74c66477dc9f17196a9ec6e75fd2a86481d70f6006cc3a WatchSource:0}: Error finding container e8f8a6a216d518d79a74c66477dc9f17196a9ec6e75fd2a86481d70f6006cc3a: Status 404 returned error can't find the container with id e8f8a6a216d518d79a74c66477dc9f17196a9ec6e75fd2a86481d70f6006cc3a Jul 06 23:50:00.609715 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.609678 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:50:00.613174 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.613159 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.627984 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.627948 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:50:00.758988 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.758945 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.759421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.759008 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46swg\" (UniqueName: \"kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.859992 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.859901 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.859992 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.859948 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46swg\" (UniqueName: \"kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.860326 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.860305 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.873470 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.873447 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46swg\" (UniqueName: \"kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg\") pod \"kuadrant-operator-controller-manager-86878c769f-mtl9v\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:00.881119 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.881084 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" event={"ID":"6dd09ee3-b4ce-4ffa-81bb-2520501370a2","Type":"ContainerStarted","Data":"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3"} Jul 06 23:50:00.881275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.881144 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" event={"ID":"6dd09ee3-b4ce-4ffa-81bb-2520501370a2","Type":"ContainerStarted","Data":"e8f8a6a216d518d79a74c66477dc9f17196a9ec6e75fd2a86481d70f6006cc3a"} Jul 06 23:50:00.881275 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.881171 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:00.882466 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.882447 2600 scope.go:117] "RemoveContainer" containerID="5e187a6eb4e77a650101c6d29e070c9b240141e3acdceef5ca1842bf830f28f5" Jul 06 23:50:00.882466 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.882464 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vfs9c" Jul 06 23:50:00.918550 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.918501 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" podStartSLOduration=1.918484235 podStartE2EDuration="1.918484235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:00.917403713 +0000 UTC m=+441.618164563" watchObservedRunningTime="2026-07-06 23:50:00.918484235 +0000 UTC m=+441.619245054" Jul 06 23:50:00.923138 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:00.923112 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:01.079800 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.079708 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:50:01.086557 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:50:01.086528 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eff9c17_0a23_4a50_ae9d_f7fe3597f0b1.slice/crio-742ece65ef97b9957d25b738f8d95d7998d68209cfcf0877d8a93bb29eeb2e88 WatchSource:0}: Error finding container 742ece65ef97b9957d25b738f8d95d7998d68209cfcf0877d8a93bb29eeb2e88: Status 404 returned error can't find the container with id 742ece65ef97b9957d25b738f8d95d7998d68209cfcf0877d8a93bb29eeb2e88 Jul 06 23:50:01.823117 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.823081 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9359950-20d2-42ad-ba9a-47adbc054f88" path="/var/lib/kubelet/pods/d9359950-20d2-42ad-ba9a-47adbc054f88/volumes" Jul 06 23:50:01.889470 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.889429 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" event={"ID":"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1","Type":"ContainerStarted","Data":"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db"} Jul 06 23:50:01.889670 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.889491 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" event={"ID":"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1","Type":"ContainerStarted","Data":"742ece65ef97b9957d25b738f8d95d7998d68209cfcf0877d8a93bb29eeb2e88"} Jul 06 23:50:01.889670 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.889540 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:01.913664 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:01.913605 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" podStartSLOduration=1.913588012 podStartE2EDuration="1.913588012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:01.910591264 +0000 UTC m=+442.611352132" watchObservedRunningTime="2026-07-06 23:50:01.913588012 +0000 UTC m=+442.614348832" Jul 06 23:50:11.892933 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:11.892902 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:12.897915 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:12.897881 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:50:12.963202 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:12.963167 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:50:12.963438 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:12.963402 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" podUID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" containerName="manager" containerID="cri-o://aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3" gracePeriod=10 Jul 06 23:50:13.209412 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.209388 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:13.264595 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.264564 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjtw4\" (UniqueName: \"kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4\") pod \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " Jul 06 23:50:13.264769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.264614 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume\") pod \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\" (UID: \"6dd09ee3-b4ce-4ffa-81bb-2520501370a2\") " Jul 06 23:50:13.265110 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.265082 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6dd09ee3-b4ce-4ffa-81bb-2520501370a2" (UID: "6dd09ee3-b4ce-4ffa-81bb-2520501370a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:50:13.266837 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.266811 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4" (OuterVolumeSpecName: "kube-api-access-cjtw4") pod "6dd09ee3-b4ce-4ffa-81bb-2520501370a2" (UID: "6dd09ee3-b4ce-4ffa-81bb-2520501370a2"). InnerVolumeSpecName "kube-api-access-cjtw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:50:13.365852 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.365818 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjtw4\" (UniqueName: \"kubernetes.io/projected/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-kube-api-access-cjtw4\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:50:13.365852 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.365844 2600 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6dd09ee3-b4ce-4ffa-81bb-2520501370a2-extensions-socket-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:50:13.955173 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.955135 2600 generic.go:356] "Generic (PLEG): container finished" podID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" containerID="aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3" exitCode=0 Jul 06 23:50:13.955619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.955212 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" Jul 06 23:50:13.955619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.955225 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" event={"ID":"6dd09ee3-b4ce-4ffa-81bb-2520501370a2","Type":"ContainerDied","Data":"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3"} Jul 06 23:50:13.955619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.955293 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz" event={"ID":"6dd09ee3-b4ce-4ffa-81bb-2520501370a2","Type":"ContainerDied","Data":"e8f8a6a216d518d79a74c66477dc9f17196a9ec6e75fd2a86481d70f6006cc3a"} Jul 06 23:50:13.955619 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.955316 2600 scope.go:117] "RemoveContainer" containerID="aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3" Jul 06 23:50:13.964441 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.964270 2600 scope.go:117] "RemoveContainer" containerID="aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3" Jul 06 23:50:13.964575 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:50:13.964552 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3\": container with ID starting with aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3 not found: ID does not exist" containerID="aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3" Jul 06 23:50:13.964676 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.964582 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3"} err="failed to get container status \"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3\": rpc error: code = NotFound desc = could not find container \"aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3\": container with ID starting with aba233062642ff0af261670e69cc7af717ccdd2579d77a5654736d860debf1a3 not found: ID does not exist" Jul 06 23:50:13.986099 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.986030 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:50:13.990455 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:13.990431 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g65hz"] Jul 06 23:50:15.823274 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:15.823235 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" path="/var/lib/kubelet/pods/6dd09ee3-b4ce-4ffa-81bb-2520501370a2/volumes" Jul 06 23:50:29.447939 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.447902 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf"] Jul 06 23:50:29.448319 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.448285 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" containerName="manager" Jul 06 23:50:29.448319 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.448297 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" containerName="manager" Jul 06 23:50:29.448388 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.448358 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd09ee3-b4ce-4ffa-81bb-2520501370a2" containerName="manager" Jul 06 23:50:29.452669 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.452651 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.455403 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.455382 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2mds5\"" Jul 06 23:50:29.472073 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.472024 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf"] Jul 06 23:50:29.494327 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494289 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494327 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494326 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494557 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494354 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494557 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494436 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab01aa0-229a-48f4-8287-bc68df929bf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494557 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494475 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvx8t\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-kube-api-access-kvx8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494557 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494501 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494738 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494572 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494738 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494611 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.494738 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.494637 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.595983 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.595941 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.595983 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.595986 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596017 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596039 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab01aa0-229a-48f4-8287-bc68df929bf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596181 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvx8t\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-kube-api-access-kvx8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596214 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596269 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596316 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596346 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596568 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596460 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596727 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596621 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596782 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596746 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596824 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596780 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.596859 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.596830 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab01aa0-229a-48f4-8287-bc68df929bf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.598595 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.598576 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.598800 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.598783 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.611339 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.611309 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.611478 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.611467 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvx8t\" (UniqueName: \"kubernetes.io/projected/eab01aa0-229a-48f4-8287-bc68df929bf4-kube-api-access-kvx8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-gg5zf\" (UID: \"eab01aa0-229a-48f4-8287-bc68df929bf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.762905 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.762869 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:29.922449 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.922420 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf"] Jul 06 23:50:29.924341 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:50:29.924309 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab01aa0_229a_48f4_8287_bc68df929bf4.slice/crio-08c1d8d899ef649121cf11a8056b3ef51a3d77fcb776d2eca238273606f422d0 WatchSource:0}: Error finding container 08c1d8d899ef649121cf11a8056b3ef51a3d77fcb776d2eca238273606f422d0: Status 404 returned error can't find the container with id 08c1d8d899ef649121cf11a8056b3ef51a3d77fcb776d2eca238273606f422d0 Jul 06 23:50:29.929934 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.929898 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:50:29.930076 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.929977 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:50:29.930076 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:29.930005 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:50:30.040818 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:30.040733 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" event={"ID":"eab01aa0-229a-48f4-8287-bc68df929bf4","Type":"ContainerStarted","Data":"ce8018a910b4e85f50b8e0e4b6c56f37d77ba2096c44cc8691b1b35edcc292be"} Jul 06 23:50:30.040818 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:30.040785 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" event={"ID":"eab01aa0-229a-48f4-8287-bc68df929bf4","Type":"ContainerStarted","Data":"08c1d8d899ef649121cf11a8056b3ef51a3d77fcb776d2eca238273606f422d0"} Jul 06 23:50:30.074810 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:30.074753 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" podStartSLOduration=1.074735568 podStartE2EDuration="1.074735568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:30.071398768 +0000 UTC m=+470.772159588" watchObservedRunningTime="2026-07-06 23:50:30.074735568 +0000 UTC m=+470.775496388" Jul 06 23:50:30.764079 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:30.764023 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:30.768919 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:30.768894 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:31.045779 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.045697 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:31.046769 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.046746 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:50:31.994414 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.994383 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:50:31.997635 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.997619 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:31.999944 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.999916 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 23:50:32.000083 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:31.999989 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v84bn\"" Jul 06 23:50:32.005741 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.005717 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:50:32.018808 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.018785 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:50:32.119045 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.119010 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj44t\" (UniqueName: \"kubernetes.io/projected/af23bf84-a526-42f1-8744-8d83ec3059ff-kube-api-access-hj44t\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.119220 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.119085 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af23bf84-a526-42f1-8744-8d83ec3059ff-config-file\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.219964 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.219935 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj44t\" (UniqueName: \"kubernetes.io/projected/af23bf84-a526-42f1-8744-8d83ec3059ff-kube-api-access-hj44t\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.220140 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.219976 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af23bf84-a526-42f1-8744-8d83ec3059ff-config-file\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.220605 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.220586 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af23bf84-a526-42f1-8744-8d83ec3059ff-config-file\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.249578 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.249513 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj44t\" (UniqueName: \"kubernetes.io/projected/af23bf84-a526-42f1-8744-8d83ec3059ff-kube-api-access-hj44t\") pod \"limitador-limitador-54d6d988d5-pw28l\" (UID: \"af23bf84-a526-42f1-8744-8d83ec3059ff\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.309372 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.309340 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:32.450110 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:32.450086 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:50:32.451579 ip-10-0-132-64 kubenswrapper[2600]: W0706 23:50:32.451552 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf23bf84_a526_42f1_8744_8d83ec3059ff.slice/crio-127340a13366bb482e3fde1fc047e243a156d7598f305dcd08dcadc71383c496 WatchSource:0}: Error finding container 127340a13366bb482e3fde1fc047e243a156d7598f305dcd08dcadc71383c496: Status 404 returned error can't find the container with id 127340a13366bb482e3fde1fc047e243a156d7598f305dcd08dcadc71383c496 Jul 06 23:50:33.063143 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:33.063038 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" event={"ID":"af23bf84-a526-42f1-8744-8d83ec3059ff","Type":"ContainerStarted","Data":"127340a13366bb482e3fde1fc047e243a156d7598f305dcd08dcadc71383c496"} Jul 06 23:50:35.076202 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:35.076166 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" event={"ID":"af23bf84-a526-42f1-8744-8d83ec3059ff","Type":"ContainerStarted","Data":"facd65893e07c6b2eae5440a07d35a4ba12cad5f7fa2e0433a43f1cda5660a9c"} Jul 06 23:50:35.076667 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:35.076284 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:50:35.100955 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:35.100854 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" podStartSLOduration=1.7118069679999999 podStartE2EDuration="4.10083915s" totalImagesPullingTime="2.389032182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:35.099016818 +0000 UTC m=+475.799777639" watchObservedRunningTime="2026-07-06 23:50:35.10083915 +0000 UTC m=+475.801600010" Jul 06 23:50:46.087366 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:50:46.087336 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pw28l" Jul 06 23:51:42.454664 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:42.454588 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:51:50.476878 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.476841 2600 generic.go:356] "Generic (PLEG): container finished" podID="eab01aa0-229a-48f4-8287-bc68df929bf4" containerID="ce8018a910b4e85f50b8e0e4b6c56f37d77ba2096c44cc8691b1b35edcc292be" exitCode=0 Jul 06 23:51:50.477349 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.476918 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" event={"ID":"eab01aa0-229a-48f4-8287-bc68df929bf4","Type":"ContainerDied","Data":"ce8018a910b4e85f50b8e0e4b6c56f37d77ba2096c44cc8691b1b35edcc292be"} Jul 06 23:51:50.477349 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.477326 2600 scope.go:117] "RemoveContainer" containerID="ce8018a910b4e85f50b8e0e4b6c56f37d77ba2096c44cc8691b1b35edcc292be" Jul 06 23:51:50.478300 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.478271 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:51:50.478359 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.478345 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:51:50.478400 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:50.478380 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 06 23:51:51.483987 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:51.483950 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" event={"ID":"eab01aa0-229a-48f4-8287-bc68df929bf4","Type":"ContainerStarted","Data":"bb05735b9205e7f636728222d2d1bc26637a6f7150844c7a81217364f1b60ad7"} Jul 06 23:51:51.763989 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:51.763898 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:51:51.764177 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:51.764138 2600 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gg5zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:51:51.764225 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:51.764183 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" podUID="eab01aa0-229a-48f4-8287-bc68df929bf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 23:51:52.763290 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:52.763241 2600 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gg5zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:51:52.763762 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:52.763346 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" podUID="eab01aa0-229a-48f4-8287-bc68df929bf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 23:51:53.763688 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:53.763652 2600 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gg5zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:51:53.764096 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:53.763706 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" podUID="eab01aa0-229a-48f4-8287-bc68df929bf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 23:51:54.763693 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:54.763651 2600 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gg5zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:51:54.764119 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:54.763715 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" podUID="eab01aa0-229a-48f4-8287-bc68df929bf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 23:51:55.766860 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:55.766827 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:51:55.767336 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:55.767246 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:51:55.768159 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:51:55.768141 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gg5zf" Jul 06 23:52:01.287284 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:01.287241 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:52:23.234676 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:23.234640 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:52:33.924209 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:33.924174 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:52:39.532282 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:39.532249 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:52:47.678245 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:47.678211 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:52:57.431502 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:52:57.431463 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:54:30.680149 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:54:30.680105 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:54:40.683867 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:54:40.683779 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:54:50.986085 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:54:50.986028 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:55:01.282251 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:55:01.282215 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:55:10.994469 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:55:10.994433 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:55:37.687047 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:55:37.686997 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:55:48.682195 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:55:48.682156 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:56:22.883421 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:56:22.883379 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:56:29.879766 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:56:29.879731 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:56:40.383556 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:56:40.383520 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:56:46.095808 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:56:46.095771 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:56:56.381683 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:56:56.381642 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:57:05.394986 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:57:05.394951 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:57:15.979257 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:57:15.979214 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:57:25.390022 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:57:25.389984 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:57:47.798179 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:57:47.798130 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:57:57.982122 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:57:57.982081 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:58:21.128798 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:58:21.128756 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:58:31.084044 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:58:31.084001 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:58:47.202541 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:58:47.202502 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:58:56.894862 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:58:56.894816 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:59:07.504521 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:07.504434 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:59:16.394277 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:16.394238 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:59:24.789025 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:24.788986 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 06 23:59:51.930342 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:51.930305 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:59:51.930987 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:51.930509 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" podUID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" containerName="manager" containerID="cri-o://5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db" gracePeriod=10 Jul 06 23:59:54.886706 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.886678 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:59:54.963438 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.963408 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume\") pod \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " Jul 06 23:59:54.963600 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.963530 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46swg\" (UniqueName: \"kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg\") pod \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\" (UID: \"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1\") " Jul 06 23:59:54.963804 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.963770 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" (UID: "9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:59:54.964019 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.963982 2600 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-extensions-socket-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:59:54.965774 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:54.965745 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg" (OuterVolumeSpecName: "kube-api-access-46swg") pod "9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" (UID: "9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1"). InnerVolumeSpecName "kube-api-access-46swg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:59:55.006824 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.006791 2600 generic.go:356] "Generic (PLEG): container finished" podID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" containerID="5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db" exitCode=0 Jul 06 23:59:55.007012 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.006832 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" Jul 06 23:59:55.007012 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.006849 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" event={"ID":"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1","Type":"ContainerDied","Data":"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db"} Jul 06 23:59:55.007012 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.006890 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v" event={"ID":"9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1","Type":"ContainerDied","Data":"742ece65ef97b9957d25b738f8d95d7998d68209cfcf0877d8a93bb29eeb2e88"} Jul 06 23:59:55.007012 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.006911 2600 scope.go:117] "RemoveContainer" containerID="5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db" Jul 06 23:59:55.017724 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.017703 2600 scope.go:117] "RemoveContainer" containerID="5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db" Jul 06 23:59:55.018007 ip-10-0-132-64 kubenswrapper[2600]: E0706 23:59:55.017986 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db\": container with ID starting with 5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db not found: ID does not exist" containerID="5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db" Jul 06 23:59:55.018116 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.018019 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db"} err="failed to get container status \"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db\": rpc error: code = NotFound desc = could not find container \"5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db\": container with ID starting with 5eda5e89202d5eea95173a3ca2890f7fc549911ea798c2d9b7aba458497883db not found: ID does not exist" Jul 06 23:59:55.033164 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.033128 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:59:55.039837 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.039809 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mtl9v"] Jul 06 23:59:55.065465 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.065426 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46swg\" (UniqueName: \"kubernetes.io/projected/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1-kube-api-access-46swg\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 06 23:59:55.822069 ip-10-0-132-64 kubenswrapper[2600]: I0706 23:59:55.822025 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" path="/var/lib/kubelet/pods/9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1/volumes" Jul 07 00:00:00.157241 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.157203 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-dp6kr"] Jul 07 00:00:00.157730 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.157694 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" containerName="manager" Jul 07 00:00:00.157730 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.157714 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" containerName="manager" Jul 07 00:00:00.157861 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.157845 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eff9c17-0a23-4a50-ae9d-f7fe3597f0b1" containerName="manager" Jul 07 00:00:00.161789 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.161764 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:00.164604 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.164583 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\"" Jul 07 00:00:00.166431 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.166405 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29723040-rjgp5"] Jul 07 00:00:00.169590 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.169571 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.172404 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.172387 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 07 00:00:00.173328 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.173114 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-hh85g\"" Jul 07 00:00:00.175887 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.175864 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-dp6kr"] Jul 07 00:00:00.193857 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.193110 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-rjgp5"] Jul 07 00:00:00.310695 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.310656 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.310695 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.310693 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4dj\" (UniqueName: \"kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj\") pod \"maas-api-key-cleanup-29723040-dp6kr\" (UID: \"15f73412-f213-4b71-bda2-13045416055c\") " pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:00.310906 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.310805 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx88k\" (UniqueName: \"kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.412018 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.411922 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.412018 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.411959 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4dj\" (UniqueName: \"kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj\") pod \"maas-api-key-cleanup-29723040-dp6kr\" (UID: \"15f73412-f213-4b71-bda2-13045416055c\") " pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:00.412018 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.412009 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx88k\" (UniqueName: \"kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.412645 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.412624 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.421887 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.421852 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx88k\" (UniqueName: \"kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k\") pod \"image-pruner-29723040-rjgp5\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.422009 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.421854 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4dj\" (UniqueName: \"kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj\") pod \"maas-api-key-cleanup-29723040-dp6kr\" (UID: \"15f73412-f213-4b71-bda2-13045416055c\") " pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:00.498684 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.498641 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:00.506846 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.506821 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:00.648855 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.648827 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723040-dp6kr"] Jul 07 00:00:00.650712 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:00:00.650676 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f73412_f213_4b71_bda2_13045416055c.slice/crio-3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836 WatchSource:0}: Error finding container 3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836: Status 404 returned error can't find the container with id 3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836 Jul 07 00:00:00.652661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.652644 2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:00:00.676349 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:00.676325 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29723040-rjgp5"] Jul 07 00:00:00.677689 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:00:00.677664 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52aa2f8_b157_42a8_8456_f913de464126.slice/crio-b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a WatchSource:0}: Error finding container b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a: Status 404 returned error can't find the container with id b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a Jul 07 00:00:01.048384 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:01.048341 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-rjgp5" event={"ID":"c52aa2f8-b157-42a8-8456-f913de464126","Type":"ContainerStarted","Data":"2af6a5cec85be72bb6a717e8248a1f67dd0e5023165b9e463742a978cb4ca0f5"} Jul 07 00:00:01.048555 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:01.048432 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-rjgp5" event={"ID":"c52aa2f8-b157-42a8-8456-f913de464126","Type":"ContainerStarted","Data":"b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a"} Jul 07 00:00:01.049639 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:01.049616 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" event={"ID":"15f73412-f213-4b71-bda2-13045416055c","Type":"ContainerStarted","Data":"3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836"} Jul 07 00:00:01.066555 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:01.066494 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29723040-rjgp5" podStartSLOduration=1.066478705 podStartE2EDuration="1.066478705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:01.0653391 +0000 UTC m=+1041.766099920" watchObservedRunningTime="2026-07-07 00:00:01.066478705 +0000 UTC m=+1041.767239503" Jul 07 00:00:02.056756 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:02.056719 2600 generic.go:356] "Generic (PLEG): container finished" podID="c52aa2f8-b157-42a8-8456-f913de464126" containerID="2af6a5cec85be72bb6a717e8248a1f67dd0e5023165b9e463742a978cb4ca0f5" exitCode=0 Jul 07 00:00:02.057198 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:02.056805 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-rjgp5" event={"ID":"c52aa2f8-b157-42a8-8456-f913de464126","Type":"ContainerDied","Data":"2af6a5cec85be72bb6a717e8248a1f67dd0e5023165b9e463742a978cb4ca0f5"} Jul 07 00:00:03.202846 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.202816 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:03.336855 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.336751 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx88k\" (UniqueName: \"kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k\") pod \"c52aa2f8-b157-42a8-8456-f913de464126\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " Jul 07 00:00:03.336855 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.336845 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca\") pod \"c52aa2f8-b157-42a8-8456-f913de464126\" (UID: \"c52aa2f8-b157-42a8-8456-f913de464126\") " Jul 07 00:00:03.337259 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.337227 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca" (OuterVolumeSpecName: "serviceca") pod "c52aa2f8-b157-42a8-8456-f913de464126" (UID: "c52aa2f8-b157-42a8-8456-f913de464126"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:00:03.339163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.339144 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k" (OuterVolumeSpecName: "kube-api-access-lx88k") pod "c52aa2f8-b157-42a8-8456-f913de464126" (UID: "c52aa2f8-b157-42a8-8456-f913de464126"). InnerVolumeSpecName "kube-api-access-lx88k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:03.437639 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.437600 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx88k\" (UniqueName: \"kubernetes.io/projected/c52aa2f8-b157-42a8-8456-f913de464126-kube-api-access-lx88k\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:00:03.437639 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:03.437633 2600 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c52aa2f8-b157-42a8-8456-f913de464126-serviceca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:00:04.070193 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:04.070160 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29723040-rjgp5" event={"ID":"c52aa2f8-b157-42a8-8456-f913de464126","Type":"ContainerDied","Data":"b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a"} Jul 07 00:00:04.070193 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:04.070186 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29723040-rjgp5" Jul 07 00:00:04.070388 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:04.070204 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a1be11af2d849624c9f80fe9ad28e06838a95e18b293fed49de686e671e62a" Jul 07 00:00:29.197004 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:29.196909 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" event={"ID":"15f73412-f213-4b71-bda2-13045416055c","Type":"ContainerStarted","Data":"14d577dfedbdd2d65d07740563bc80da8c220919abbd0c8d7f02f48d92aaf79e"} Jul 07 00:00:29.235889 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:29.235838 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" podStartSLOduration=1.195186103 podStartE2EDuration="29.235821741s" totalImagesPullingTime="28.040635638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:29.233937138 +0000 UTC m=+1069.934697959" watchObservedRunningTime="2026-07-07 00:00:29.235821741 +0000 UTC m=+1069.936582570" Jul 07 00:00:30.203495 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:30.203461 2600 generic.go:356] "Generic (PLEG): container finished" podID="15f73412-f213-4b71-bda2-13045416055c" containerID="14d577dfedbdd2d65d07740563bc80da8c220919abbd0c8d7f02f48d92aaf79e" exitCode=0 Jul 07 00:00:30.203874 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:30.203542 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" event={"ID":"15f73412-f213-4b71-bda2-13045416055c","Type":"ContainerDied","Data":"14d577dfedbdd2d65d07740563bc80da8c220919abbd0c8d7f02f48d92aaf79e"} Jul 07 00:00:31.344618 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:31.344588 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:31.488573 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:31.488537 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f4dj\" (UniqueName: \"kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj\") pod \"15f73412-f213-4b71-bda2-13045416055c\" (UID: \"15f73412-f213-4b71-bda2-13045416055c\") " Jul 07 00:00:31.490916 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:31.490879 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj" (OuterVolumeSpecName: "kube-api-access-2f4dj") pod "15f73412-f213-4b71-bda2-13045416055c" (UID: "15f73412-f213-4b71-bda2-13045416055c"). InnerVolumeSpecName "kube-api-access-2f4dj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:00:31.589539 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:31.589501 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f4dj\" (UniqueName: \"kubernetes.io/projected/15f73412-f213-4b71-bda2-13045416055c-kube-api-access-2f4dj\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:00:32.217150 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:32.217067 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" Jul 07 00:00:32.217150 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:32.217093 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723040-dp6kr" event={"ID":"15f73412-f213-4b71-bda2-13045416055c","Type":"ContainerDied","Data":"3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836"} Jul 07 00:00:32.217150 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:32.217141 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a7660bbb41ad1259dca065f7e84587eee6a4e20c902f06576f68ed3fd4e5836" Jul 07 00:00:53.074513 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074478 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf"] Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074802 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c52aa2f8-b157-42a8-8456-f913de464126" containerName="image-pruner" Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074814 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="c52aa2f8-b157-42a8-8456-f913de464126" containerName="image-pruner" Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074832 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f73412-f213-4b71-bda2-13045416055c" containerName="cleanup" Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074837 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f73412-f213-4b71-bda2-13045416055c" containerName="cleanup" Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074887 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f73412-f213-4b71-bda2-13045416055c" containerName="cleanup" Jul 07 00:00:53.075100 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.074896 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="c52aa2f8-b157-42a8-8456-f913de464126" containerName="image-pruner" Jul 07 00:00:53.079128 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.079111 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.082381 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.082359 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rbcjd\"" Jul 07 00:00:53.091442 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.091420 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf"] Jul 07 00:00:53.168021 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.167989 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2bm\" (UniqueName: \"kubernetes.io/projected/a4efd5e7-fdda-4be7-82ff-582149bef4b6-kube-api-access-pr2bm\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.168223 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.168042 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4efd5e7-fdda-4be7-82ff-582149bef4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.268788 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.268751 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2bm\" (UniqueName: \"kubernetes.io/projected/a4efd5e7-fdda-4be7-82ff-582149bef4b6-kube-api-access-pr2bm\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.268952 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.268821 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4efd5e7-fdda-4be7-82ff-582149bef4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.269253 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.269234 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4efd5e7-fdda-4be7-82ff-582149bef4b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.280323 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.280292 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2bm\" (UniqueName: \"kubernetes.io/projected/a4efd5e7-fdda-4be7-82ff-582149bef4b6-kube-api-access-pr2bm\") pod \"kuadrant-operator-controller-manager-86878c769f-xvmzf\" (UID: \"a4efd5e7-fdda-4be7-82ff-582149bef4b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.388689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.388592 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:53.546835 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:53.546806 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf"] Jul 07 00:00:53.547628 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:00:53.547592 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4efd5e7_fdda_4be7_82ff_582149bef4b6.slice/crio-5f00d013e642e6b1c1cfae1cecf291a3c062069c0f7ceab63df6ca3cdfb53bc7 WatchSource:0}: Error finding container 5f00d013e642e6b1c1cfae1cecf291a3c062069c0f7ceab63df6ca3cdfb53bc7: Status 404 returned error can't find the container with id 5f00d013e642e6b1c1cfae1cecf291a3c062069c0f7ceab63df6ca3cdfb53bc7 Jul 07 00:00:54.330901 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:54.330860 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" event={"ID":"a4efd5e7-fdda-4be7-82ff-582149bef4b6","Type":"ContainerStarted","Data":"71edede7f759ff9495366ca5e694153f7f4cf9a87c719907cdff1eb68a115a7e"} Jul 07 00:00:54.331294 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:54.330929 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" event={"ID":"a4efd5e7-fdda-4be7-82ff-582149bef4b6","Type":"ContainerStarted","Data":"5f00d013e642e6b1c1cfae1cecf291a3c062069c0f7ceab63df6ca3cdfb53bc7"} Jul 07 00:00:54.331294 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:54.330961 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:00:54.352751 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:00:54.352693 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" podStartSLOduration=1.352674702 podStartE2EDuration="1.352674702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:54.350013998 +0000 UTC m=+1095.050774859" watchObservedRunningTime="2026-07-07 00:00:54.352674702 +0000 UTC m=+1095.053435579" Jul 07 00:01:05.338505 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:05.338470 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvmzf" Jul 07 00:01:14.584898 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:14.584863 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:01:23.680986 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:23.680949 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:01:35.777607 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:35.777563 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:01:44.579336 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:44.579298 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:01:53.980330 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:01:53.980294 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:02.488989 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:02.484536 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:13.183964 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:13.183922 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:20.481956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:20.481921 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:29.192675 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:29.192638 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:39.683904 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:39.683865 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:49.384645 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:49.384601 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:02:59.783608 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:02:59.783563 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:03:22.693155 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:03:22.693117 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:03:31.595024 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:03:31.594938 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:03:40.892626 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:03:40.892595 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:03:52.591660 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:03:52.591624 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:09.585079 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:09.585019 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:20.782237 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:20.782203 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:29.582994 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:29.582962 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:40.239480 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:40.239446 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:48.691580 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:48.691542 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:04:57.786007 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:04:57.785961 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:05:10.508263 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:05:10.508177 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:05:20.186664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:05:20.186626 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:05:31.586224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:05:31.586183 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:05:40.489626 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:05:40.489594 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:05:49.289613 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:05:49.289575 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:00.890360 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:00.890324 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:17.392606 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:17.392561 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:28.786312 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:28.786283 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:39.587567 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:39.587529 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:51.100887 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:51.100850 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:06:59.997847 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:06:59.997808 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:07:09.294569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:09.294531 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:07:10.141901 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.141870 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:10.145911 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.145887 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.149393 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.149364 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e12b8e24-openshift-default-dockercfg-rxlt2\"" Jul 07 00:07:10.179160 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.179128 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:10.236801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.236769 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.236988 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.236827 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.236988 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.236907 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.236988 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.236967 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.237146 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.237002 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbnj\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.237146 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.237040 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.237146 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.237073 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.237146 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.237131 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.237291 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.237152 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.337955 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.337915 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.337979 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338009 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338045 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbnj\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338121 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338155 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338187 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338212 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338474 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338249 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338814 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338578 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338814 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338629 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338814 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338735 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.338948 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.338847 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.339311 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.339290 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.340555 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.340533 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.340998 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.340978 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.354861 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.354838 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbnj\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.356647 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.356623 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token\") pod \"e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.457543 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.457448 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:10.607555 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.607529 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:10.608883 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:07:10.608856 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbf1aca_ec42_4baa_ad50_a59d9e40b016.slice/crio-852db5f062f208ea1c5fd63a3c9632acc18d0f564187215f66573e37f2450571 WatchSource:0}: Error finding container 852db5f062f208ea1c5fd63a3c9632acc18d0f564187215f66573e37f2450571: Status 404 returned error can't find the container with id 852db5f062f208ea1c5fd63a3c9632acc18d0f564187215f66573e37f2450571 Jul 07 00:07:10.610920 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.610889 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:10.611001 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.610959 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:10.611001 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:10.610987 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:11.343167 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.343128 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" event={"ID":"fdbf1aca-ec42-4baa-ad50-a59d9e40b016","Type":"ContainerStarted","Data":"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6"} Jul 07 00:07:11.343603 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.343196 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" event={"ID":"fdbf1aca-ec42-4baa-ad50-a59d9e40b016","Type":"ContainerStarted","Data":"852db5f062f208ea1c5fd63a3c9632acc18d0f564187215f66573e37f2450571"} Jul 07 00:07:11.390962 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.390892 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" podStartSLOduration=1.390876442 podStartE2EDuration="1.390876442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:11.387353626 +0000 UTC m=+1472.088114452" watchObservedRunningTime="2026-07-07 00:07:11.390876442 +0000 UTC m=+1472.091637262" Jul 07 00:07:11.457736 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.457700 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:11.458898 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.458866 2600 patch_prober.go:28] interesting pod/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 07 00:07:11.459038 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:11.458924 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 07 00:07:12.461699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:12.461669 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:13.353487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:13.353456 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:13.354457 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:13.354438 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:16.677508 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:16.677464 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:16.677988 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:16.677698 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerName="istio-proxy" containerID="cri-o://6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6" gracePeriod=30 Jul 07 00:07:22.133417 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.133386 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:22.142598 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142575 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142612 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142665 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142693 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142719 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqbnj\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142921 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142795 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142921 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142837 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.142921 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142864 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.143090 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.142923 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs\") pod \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\" (UID: \"fdbf1aca-ec42-4baa-ad50-a59d9e40b016\") " Jul 07 00:07:22.143151 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143118 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:07:22.143528 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143236 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.143528 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143322 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:22.143528 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143348 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:22.143528 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143454 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:22.143957 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.143610 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:22.145366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.145338 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:22.145366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.145355 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:07:22.145730 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.145701 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:22.145820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.145769 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj" (OuterVolumeSpecName: "kube-api-access-nqbnj") pod "fdbf1aca-ec42-4baa-ad50-a59d9e40b016" (UID: "fdbf1aca-ec42-4baa-ad50-a59d9e40b016"). InnerVolumeSpecName "kube-api-access-nqbnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:22.244362 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244329 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244362 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244357 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244362 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244368 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244377 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244385 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244392 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244400 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.244801 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.244409 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqbnj\" (UniqueName: \"kubernetes.io/projected/fdbf1aca-ec42-4baa-ad50-a59d9e40b016-kube-api-access-nqbnj\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:22.413092 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.413010 2600 generic.go:356] "Generic (PLEG): container finished" podID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerID="6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6" exitCode=0 Jul 07 00:07:22.413092 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.413089 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" Jul 07 00:07:22.413715 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.413078 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" event={"ID":"fdbf1aca-ec42-4baa-ad50-a59d9e40b016","Type":"ContainerDied","Data":"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6"} Jul 07 00:07:22.413715 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.413321 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt" event={"ID":"fdbf1aca-ec42-4baa-ad50-a59d9e40b016","Type":"ContainerDied","Data":"852db5f062f208ea1c5fd63a3c9632acc18d0f564187215f66573e37f2450571"} Jul 07 00:07:22.413715 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.413370 2600 scope.go:117] "RemoveContainer" containerID="6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6" Jul 07 00:07:22.424172 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.424149 2600 scope.go:117] "RemoveContainer" containerID="6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6" Jul 07 00:07:22.424510 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:07:22.424484 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6\": container with ID starting with 6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6 not found: ID does not exist" containerID="6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6" Jul 07 00:07:22.424572 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.424523 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6"} err="failed to get container status \"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6\": rpc error: code = NotFound desc = could not find container \"6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6\": container with ID starting with 6d66d78c612c3b8a607f36bd1337ea8a297be15a28d7db716f75609397f9d2c6 not found: ID does not exist" Jul 07 00:07:22.438443 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.438414 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:22.443827 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.443804 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e12b8e24-openshift-default-7bc8c545b9-mqmmt"] Jul 07 00:07:22.986544 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.986506 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:22.988175 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.987315 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerName="istio-proxy" Jul 07 00:07:22.988175 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.987366 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerName="istio-proxy" Jul 07 00:07:22.988175 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.987471 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" containerName="istio-proxy" Jul 07 00:07:22.992447 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.992423 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:22.995274 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:22.995240 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7ceb5ec-openshift-default-dockercfg-qg8nm\"" Jul 07 00:07:23.005796 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.005770 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:23.054349 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054312 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054349 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054353 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054373 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054403 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054452 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfdh\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054472 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054685 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054551 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054685 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054609 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.054685 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.054667 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.155791 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155752 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155805 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155833 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155851 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155891 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155915 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfdh\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155942 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.155989 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156039 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156261 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156288 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156823 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156578 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156823 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156660 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.156823 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.156661 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.158957 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.158933 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.159165 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.159145 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.164386 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.164365 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.164469 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.164429 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfdh\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh\") pod \"e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.306164 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.306079 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:23.449776 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.449749 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:23.450982 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:07:23.450955 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8362cc_b417_4be9_9927_920c9d6302a8.slice/crio-8194e3e5253493c1cdae1318bffa058a998eee377d3d3f57a820815e94e9c3a9 WatchSource:0}: Error finding container 8194e3e5253493c1cdae1318bffa058a998eee377d3d3f57a820815e94e9c3a9: Status 404 returned error can't find the container with id 8194e3e5253493c1cdae1318bffa058a998eee377d3d3f57a820815e94e9c3a9 Jul 07 00:07:23.453082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.453030 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:23.453158 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.453115 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:23.453158 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.453142 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:23.823136 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:23.823105 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbf1aca-ec42-4baa-ad50-a59d9e40b016" path="/var/lib/kubelet/pods/fdbf1aca-ec42-4baa-ad50-a59d9e40b016/volumes" Jul 07 00:07:24.429821 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:24.429785 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerStarted","Data":"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932"} Jul 07 00:07:24.430391 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:24.429847 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerStarted","Data":"8194e3e5253493c1cdae1318bffa058a998eee377d3d3f57a820815e94e9c3a9"} Jul 07 00:07:24.457499 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:24.457438 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" podStartSLOduration=2.457423538 podStartE2EDuration="2.457423538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:24.455865532 +0000 UTC m=+1485.156626377" watchObservedRunningTime="2026-07-07 00:07:24.457423538 +0000 UTC m=+1485.158184357" Jul 07 00:07:25.306545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:25.306508 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:25.311956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:25.311927 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:25.436112 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:25.436076 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:25.437215 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:25.437194 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:26.693090 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:26.692978 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:07:34.488964 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.488931 2600 generic.go:356] "Generic (PLEG): container finished" podID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerID="d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932" exitCode=0 Jul 07 00:07:34.489416 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.489012 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerDied","Data":"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932"} Jul 07 00:07:34.489473 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.489463 2600 scope.go:117] "RemoveContainer" containerID="d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932" Jul 07 00:07:34.490469 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.490441 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:34.490569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.490503 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:34.490569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:34.490536 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:35.496659 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:35.496624 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerStarted","Data":"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4"} Jul 07 00:07:35.497132 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:35.497039 2600 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" secret="" err="secret \"e2e-ait-f7ceb5ec-openshift-default-dockercfg-qg8nm\" not found" Jul 07 00:07:35.502580 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:35.502548 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:36.306459 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:36.306420 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:36.311105 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:36.311079 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:36.502422 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:36.502382 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" containerID="cri-o://0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4" gracePeriod=30 Jul 07 00:07:36.502891 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:36.502543 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:36.503771 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:36.503751 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:38.279227 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:38.279194 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:07:41.760962 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.760888 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:41.834398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834359 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:41.834749 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834736 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.834793 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834754 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.834793 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834763 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.834793 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834769 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.834885 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834821 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.834885 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.834834 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerName="istio-proxy" Jul 07 00:07:41.837790 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.837769 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.842560 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.842534 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f3b263a4-openshift-default-dockercfg-qw2pp\"" Jul 07 00:07:41.844774 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844675 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.844774 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844734 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.844774 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844766 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdfdh\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.844975 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844816 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.844975 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844871 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.844975 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844916 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.845167 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.844984 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.845167 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.845007 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.845167 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.845037 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket\") pod \"3d8362cc-b417-4be9-9927-920c9d6302a8\" (UID: \"3d8362cc-b417-4be9-9927-920c9d6302a8\") " Jul 07 00:07:41.845471 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.845441 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:41.845914 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.845690 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:41.845914 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.845870 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:41.846438 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.846415 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:07:41.846634 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.846603 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:41.849032 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.848851 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:41.849160 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.849078 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:07:41.849701 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.849676 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:41.850264 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.850231 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh" (OuterVolumeSpecName: "kube-api-access-kdfdh") pod "3d8362cc-b417-4be9-9927-920c9d6302a8" (UID: "3d8362cc-b417-4be9-9927-920c9d6302a8"). InnerVolumeSpecName "kube-api-access-kdfdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:41.851729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.851709 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:41.946001 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.945961 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946001 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946001 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946027 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946137 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946180 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946200 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf9w2\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946219 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946260 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946260 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946289 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946371 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946388 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdfdh\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-kube-api-access-kdfdh\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946398 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946408 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946417 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946425 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946432 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d8362cc-b417-4be9-9927-920c9d6302a8-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946441 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d8362cc-b417-4be9-9927-920c9d6302a8-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:41.946476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:41.946450 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d8362cc-b417-4be9-9927-920c9d6302a8-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:42.047737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047657 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.047737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047696 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.047737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047717 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf9w2\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.047956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047840 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.047956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047885 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.047956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047933 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048123 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.047999 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048123 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048028 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048123 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048084 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048123 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048026 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048337 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048285 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048427 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048409 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048495 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048435 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.048640 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.048625 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.049981 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.049958 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.050390 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.050373 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.056586 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.056565 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf9w2\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.056916 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.056900 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token\") pod \"e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.151374 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.151338 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:42.294741 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.294714 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:42.296639 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:07:42.296605 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fdb1a4_4e3f_4399_a446_7760adf0c208.slice/crio-658199091ac9d81a290122ff42f895190025eb0352baac18bf9ddcd3af0e9dfc WatchSource:0}: Error finding container 658199091ac9d81a290122ff42f895190025eb0352baac18bf9ddcd3af0e9dfc: Status 404 returned error can't find the container with id 658199091ac9d81a290122ff42f895190025eb0352baac18bf9ddcd3af0e9dfc Jul 07 00:07:42.298747 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.298711 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:42.298840 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.298779 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:42.298840 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.298807 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:07:42.538925 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.538887 2600 generic.go:356] "Generic (PLEG): container finished" podID="3d8362cc-b417-4be9-9927-920c9d6302a8" containerID="0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4" exitCode=0 Jul 07 00:07:42.539143 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.538956 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" Jul 07 00:07:42.539143 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.538975 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerDied","Data":"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4"} Jul 07 00:07:42.539143 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.539043 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7" event={"ID":"3d8362cc-b417-4be9-9927-920c9d6302a8","Type":"ContainerDied","Data":"8194e3e5253493c1cdae1318bffa058a998eee377d3d3f57a820815e94e9c3a9"} Jul 07 00:07:42.539143 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.539093 2600 scope.go:117] "RemoveContainer" containerID="0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4" Jul 07 00:07:42.541244 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.541162 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" event={"ID":"33fdb1a4-4e3f-4399-a446-7760adf0c208","Type":"ContainerStarted","Data":"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53"} Jul 07 00:07:42.541244 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.541216 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" event={"ID":"33fdb1a4-4e3f-4399-a446-7760adf0c208","Type":"ContainerStarted","Data":"658199091ac9d81a290122ff42f895190025eb0352baac18bf9ddcd3af0e9dfc"} Jul 07 00:07:42.556885 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.556575 2600 scope.go:117] "RemoveContainer" containerID="d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932" Jul 07 00:07:42.565933 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.565879 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" podStartSLOduration=1.565858553 podStartE2EDuration="1.565858553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:42.56132006 +0000 UTC m=+1503.262080880" watchObservedRunningTime="2026-07-07 00:07:42.565858553 +0000 UTC m=+1503.266619354" Jul 07 00:07:42.566386 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.566365 2600 scope.go:117] "RemoveContainer" containerID="0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4" Jul 07 00:07:42.566673 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:07:42.566655 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4\": container with ID starting with 0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4 not found: ID does not exist" containerID="0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4" Jul 07 00:07:42.566727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.566681 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4"} err="failed to get container status \"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4\": rpc error: code = NotFound desc = could not find container \"0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4\": container with ID starting with 0b54522fb350b752a5a2b845d9ac56d81a3ad0b902c8a2ef10af9c2d127206a4 not found: ID does not exist" Jul 07 00:07:42.566727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.566698 2600 scope.go:117] "RemoveContainer" containerID="d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932" Jul 07 00:07:42.566948 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:07:42.566927 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932\": container with ID starting with d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932 not found: ID does not exist" containerID="d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932" Jul 07 00:07:42.567002 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.566957 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932"} err="failed to get container status \"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932\": rpc error: code = NotFound desc = could not find container \"d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932\": container with ID starting with d9ebb9e1486f36ad5ef08c7a89f7e97677594dd14e83c343b7ea8fab90ca9932 not found: ID does not exist" Jul 07 00:07:42.575596 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.575569 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:42.579930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:42.579907 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7ceb5ec-openshift-default-cd59849ff-8dkx7"] Jul 07 00:07:43.151888 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:43.151849 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:43.156873 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:43.156847 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:43.547947 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:43.547916 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:43.548798 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:43.548780 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:43.822975 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:43.822896 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8362cc-b417-4be9-9927-920c9d6302a8" path="/var/lib/kubelet/pods/3d8362cc-b417-4be9-9927-920c9d6302a8/volumes" Jul 07 00:07:46.783176 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:46.783135 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:07:47.596257 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:47.596213 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:47.596591 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:47.596536 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" podUID="33fdb1a4-4e3f-4399-a446-7760adf0c208" containerName="istio-proxy" containerID="cri-o://e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53" gracePeriod=30 Jul 07 00:07:52.861277 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:52.861250 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:53.048602 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048567 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048602 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048602 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048622 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048648 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048686 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf9w2\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048738 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048773 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048813 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.048844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048838 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo\") pod \"33fdb1a4-4e3f-4399-a446-7760adf0c208\" (UID: \"33fdb1a4-4e3f-4399-a446-7760adf0c208\") " Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.048932 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049026 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049038 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049169 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049186 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33fdb1a4-4e3f-4399-a446-7760adf0c208-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.049218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049199 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.049540 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.049216 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:53.050141 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.050110 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data" (OuterVolumeSpecName: "istio-data") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:53.051303 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.051272 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token" (OuterVolumeSpecName: "istio-token") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:53.051303 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.051277 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:07:53.051447 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.051351 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2" (OuterVolumeSpecName: "kube-api-access-jf9w2") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "kube-api-access-jf9w2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:07:53.051681 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.051658 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33fdb1a4-4e3f-4399-a446-7760adf0c208" (UID: "33fdb1a4-4e3f-4399-a446-7760adf0c208"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:07:53.150642 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150603 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf9w2\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-kube-api-access-jf9w2\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.150642 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150637 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.150642 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150647 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.150881 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150655 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.150881 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150664 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.150881 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.150671 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33fdb1a4-4e3f-4399-a446-7760adf0c208-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:07:53.605330 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.605295 2600 generic.go:356] "Generic (PLEG): container finished" podID="33fdb1a4-4e3f-4399-a446-7760adf0c208" containerID="e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53" exitCode=0 Jul 07 00:07:53.605504 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.605339 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" event={"ID":"33fdb1a4-4e3f-4399-a446-7760adf0c208","Type":"ContainerDied","Data":"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53"} Jul 07 00:07:53.605504 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.605364 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" Jul 07 00:07:53.605504 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.605429 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg" event={"ID":"33fdb1a4-4e3f-4399-a446-7760adf0c208","Type":"ContainerDied","Data":"658199091ac9d81a290122ff42f895190025eb0352baac18bf9ddcd3af0e9dfc"} Jul 07 00:07:53.605504 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.605461 2600 scope.go:117] "RemoveContainer" containerID="e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53" Jul 07 00:07:53.614997 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.614971 2600 scope.go:117] "RemoveContainer" containerID="e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53" Jul 07 00:07:53.615310 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:07:53.615289 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53\": container with ID starting with e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53 not found: ID does not exist" containerID="e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53" Jul 07 00:07:53.615375 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.615321 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53"} err="failed to get container status \"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53\": rpc error: code = NotFound desc = could not find container \"e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53\": container with ID starting with e89c2164b5f26a2f2bf4e37da1f25c319c472f5a163221c7184c5d1a92f80d53 not found: ID does not exist" Jul 07 00:07:53.627895 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.627866 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:53.632353 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.632330 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f3b263a4-openshift-default-54b69497f9-mbmmg"] Jul 07 00:07:53.823065 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:53.823017 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33fdb1a4-4e3f-4399-a446-7760adf0c208" path="/var/lib/kubelet/pods/33fdb1a4-4e3f-4399-a446-7760adf0c208/volumes" Jul 07 00:07:56.588446 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:07:56.588412 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:08:06.982398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:08:06.982316 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:15.981447 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:15.981409 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:23.183941 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:23.183903 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:29.468813 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.468779 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:29.469196 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.469168 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fdb1a4-4e3f-4399-a446-7760adf0c208" containerName="istio-proxy" Jul 07 00:09:29.469196 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.469180 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fdb1a4-4e3f-4399-a446-7760adf0c208" containerName="istio-proxy" Jul 07 00:09:29.469271 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.469239 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="33fdb1a4-4e3f-4399-a446-7760adf0c208" containerName="istio-proxy" Jul 07 00:09:29.472352 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.472335 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.475403 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.475372 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-27ba4332-openshift-default-dockercfg-f77n2\"" Jul 07 00:09:29.496917 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.496892 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:29.603797 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603760 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603822 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603845 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603860 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603886 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjmvk\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603944 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.603967 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.603962 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.604287 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.604044 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.604287 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.604122 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.704910 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.704851 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.704917 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.704946 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.704987 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjmvk\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705028 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705073 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705142 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705120 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705462 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705166 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705462 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705207 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705462 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705314 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705629 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705574 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.705906 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705880 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.706363 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.705925 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.706363 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.706306 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.707902 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.707870 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.708305 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.708288 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.713704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.713678 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.713839 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.713779 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjmvk\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk\") pod \"e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.782227 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.782190 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:29.925520 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.925490 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:29.927005 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:09:29.926974 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937c877c_f054_4e92_b2ed_354e66857dd6.slice/crio-132f98b29147f5620472d31fe542c19c1e06e23d7354b2fd0ac259c968615614 WatchSource:0}: Error finding container 132f98b29147f5620472d31fe542c19c1e06e23d7354b2fd0ac259c968615614: Status 404 returned error can't find the container with id 132f98b29147f5620472d31fe542c19c1e06e23d7354b2fd0ac259c968615614 Jul 07 00:09:29.929140 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.929106 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:29.929245 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.929188 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:29.929245 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:29.929238 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:30.120536 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:30.120445 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerStarted","Data":"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd"} Jul 07 00:09:30.120536 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:30.120499 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerStarted","Data":"132f98b29147f5620472d31fe542c19c1e06e23d7354b2fd0ac259c968615614"} Jul 07 00:09:30.143946 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:30.143891 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podStartSLOduration=1.143872512 podStartE2EDuration="1.143872512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:09:30.140942717 +0000 UTC m=+1610.841703541" watchObservedRunningTime="2026-07-07 00:09:30.143872512 +0000 UTC m=+1610.844633333" Jul 07 00:09:30.782813 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:30.782777 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:30.787772 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:30.787747 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:31.125645 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:31.125515 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:31.126536 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:31.126515 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:31.482583 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:31.482548 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:42.190472 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:42.190429 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:45.201988 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.201902 2600 generic.go:356] "Generic (PLEG): container finished" podID="937c877c-f054-4e92-b2ed-354e66857dd6" containerID="50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd" exitCode=0 Jul 07 00:09:45.202416 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.201980 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerDied","Data":"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd"} Jul 07 00:09:45.202416 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.202406 2600 scope.go:117] "RemoveContainer" containerID="50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd" Jul 07 00:09:45.203554 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.203520 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:45.203659 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.203610 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:45.203721 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:45.203659 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:09:46.125871 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:46.125831 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:46.214436 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:46.214399 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerStarted","Data":"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208"} Jul 07 00:09:46.782939 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:46.782899 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:46.783951 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:46.783918 2600 patch_prober.go:28] interesting pod/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 07 00:09:46.784115 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:46.783977 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 07 00:09:47.783221 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:47.783180 2600 patch_prober.go:28] interesting pod/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 07 00:09:47.783739 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:47.783247 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 07 00:09:48.782816 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:48.782782 2600 patch_prober.go:28] interesting pod/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 07 00:09:48.782994 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:48.782839 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 07 00:09:49.782781 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:49.782743 2600 patch_prober.go:28] interesting pod/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 07 00:09:49.783240 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:49.782818 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 07 00:09:50.188557 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:50.188466 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:09:50.786621 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:50.786589 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:50.787010 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:50.786873 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:50.793537 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:50.788250 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:50.978855 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:50.978819 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:51.245364 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:51.245322 2600 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" secret="" err="secret \"e2e-mt-27ba4332-openshift-default-dockercfg-f77n2\" not found" Jul 07 00:09:52.250373 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:52.250331 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" containerID="cri-o://2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208" gracePeriod=30 Jul 07 00:09:57.515352 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.515324 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:57.550487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550395 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550440 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550507 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550563 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550604 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjmvk\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550628 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550655 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.550712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550673 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:09:57.551026 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.550979 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:09:57.551113 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551025 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:09:57.551189 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551172 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.551243 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551209 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket\") pod \"937c877c-f054-4e92-b2ed-354e66857dd6\" (UID: \"937c877c-f054-4e92-b2ed-354e66857dd6\") " Jul 07 00:09:57.551604 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551522 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.551604 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551546 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.551604 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551559 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/937c877c-f054-4e92-b2ed-354e66857dd6-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.551604 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551582 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:09:57.551867 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.551790 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:09:57.553016 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.552989 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:09:57.553185 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.553079 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk" (OuterVolumeSpecName: "kube-api-access-vjmvk") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "kube-api-access-vjmvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:09:57.553612 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.553595 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:09:57.553713 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.553690 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "937c877c-f054-4e92-b2ed-354e66857dd6" (UID: "937c877c-f054-4e92-b2ed-354e66857dd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:09:57.652481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652447 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.652481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652478 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.652689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652489 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjmvk\" (UniqueName: \"kubernetes.io/projected/937c877c-f054-4e92-b2ed-354e66857dd6-kube-api-access-vjmvk\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.652689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652499 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/937c877c-f054-4e92-b2ed-354e66857dd6-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.652689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652508 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:57.652689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:57.652516 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/937c877c-f054-4e92-b2ed-354e66857dd6-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:09:58.282871 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.282831 2600 generic.go:356] "Generic (PLEG): container finished" podID="937c877c-f054-4e92-b2ed-354e66857dd6" containerID="2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208" exitCode=0 Jul 07 00:09:58.283098 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.282900 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" Jul 07 00:09:58.283098 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.282912 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerDied","Data":"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208"} Jul 07 00:09:58.283098 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.282968 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j" event={"ID":"937c877c-f054-4e92-b2ed-354e66857dd6","Type":"ContainerDied","Data":"132f98b29147f5620472d31fe542c19c1e06e23d7354b2fd0ac259c968615614"} Jul 07 00:09:58.283098 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.282992 2600 scope.go:117] "RemoveContainer" containerID="2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208" Jul 07 00:09:58.292354 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.292326 2600 scope.go:117] "RemoveContainer" containerID="50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd" Jul 07 00:09:58.300672 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.300652 2600 scope.go:117] "RemoveContainer" containerID="2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208" Jul 07 00:09:58.300949 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:09:58.300931 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208\": container with ID starting with 2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208 not found: ID does not exist" containerID="2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208" Jul 07 00:09:58.300998 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.300959 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208"} err="failed to get container status \"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208\": rpc error: code = NotFound desc = could not find container \"2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208\": container with ID starting with 2b7324e91ece93e3c2366811ce5c86f92a2e5ceb1b89a2e2b03ac07c25816208 not found: ID does not exist" Jul 07 00:09:58.300998 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.300985 2600 scope.go:117] "RemoveContainer" containerID="50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd" Jul 07 00:09:58.301274 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:09:58.301259 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd\": container with ID starting with 50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd not found: ID does not exist" containerID="50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd" Jul 07 00:09:58.301356 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.301277 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd"} err="failed to get container status \"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd\": rpc error: code = NotFound desc = could not find container \"50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd\": container with ID starting with 50939c24863b6d7a577881f48d401cdcd2ebc44856491b8f6c8fada9b1fbaadd not found: ID does not exist" Jul 07 00:09:58.305121 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.305099 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:58.309610 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:58.309589 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-27ba4332-openshift-default-8c65bf95f-bvv7j"] Jul 07 00:09:59.822018 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:09:59.821985 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" path="/var/lib/kubelet/pods/937c877c-f054-4e92-b2ed-354e66857dd6/volumes" Jul 07 00:10:10.983072 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983018 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:10:10.983551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983539 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:10:10.983626 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983558 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:10:10.983626 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983595 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:10:10.983626 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983604 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:10:10.983770 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.983683 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:10:10.986780 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.986759 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:10.996860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:10.996838 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-522f0b74-openshift-default-dockercfg-jwm9r\"" Jul 07 00:10:11.014437 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.014409 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:10:11.075206 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075168 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075339 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075382 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmpdf\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075411 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075504 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075545 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075568 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075593 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.075662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.075622 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177077 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177018 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177246 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177118 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177246 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177142 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmpdf\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177246 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177167 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177246 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177197 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177484 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177222 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177484 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177290 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177484 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177322 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177484 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177355 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177545 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177621 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177804 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177716 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.177892 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.177866 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.178476 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.178451 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.179901 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.179876 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.180360 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.180341 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.188677 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.188654 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.188875 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.188855 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmpdf\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf\") pod \"e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.297882 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.297784 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:11.444735 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.444706 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:10:11.446173 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:10:11.446126 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b30f0ab_3ad4_4e3a_a57c_b5472ef40e12.slice/crio-7e763ab64dffd1153178023c74b745765ea10646fd1f49218f6f6c31a2d91beb WatchSource:0}: Error finding container 7e763ab64dffd1153178023c74b745765ea10646fd1f49218f6f6c31a2d91beb: Status 404 returned error can't find the container with id 7e763ab64dffd1153178023c74b745765ea10646fd1f49218f6f6c31a2d91beb Jul 07 00:10:11.448225 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.448187 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:11.448285 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.448261 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:11.448330 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:11.448294 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:12.360233 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:12.360196 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerStarted","Data":"c0150db42363a34df97bab3edcdac6b1cae4f5f9e44e19c998beb93183bcc7f2"} Jul 07 00:10:12.360628 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:12.360247 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerStarted","Data":"7e763ab64dffd1153178023c74b745765ea10646fd1f49218f6f6c31a2d91beb"} Jul 07 00:10:12.383406 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:12.383354 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podStartSLOduration=2.383337934 podStartE2EDuration="2.383337934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:10:12.380802163 +0000 UTC m=+1653.081562984" watchObservedRunningTime="2026-07-07 00:10:12.383337934 +0000 UTC m=+1653.084098755" Jul 07 00:10:13.298026 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:13.297992 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:13.303799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:13.303774 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:13.365966 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:13.365927 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:13.366725 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:13.366708 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:20.187889 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:20.187847 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:10:28.367453 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.367347 2600 patch_prober.go:28] interesting pod/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 00:10:28.367453 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.367405 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 00:10:28.463264 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.463223 2600 generic.go:356] "Generic (PLEG): container finished" podID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerID="c0150db42363a34df97bab3edcdac6b1cae4f5f9e44e19c998beb93183bcc7f2" exitCode=0 Jul 07 00:10:28.463435 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.463297 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerDied","Data":"c0150db42363a34df97bab3edcdac6b1cae4f5f9e44e19c998beb93183bcc7f2"} Jul 07 00:10:28.463686 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.463672 2600 scope.go:117] "RemoveContainer" containerID="c0150db42363a34df97bab3edcdac6b1cae4f5f9e44e19c998beb93183bcc7f2" Jul 07 00:10:28.464742 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.464712 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:28.464824 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.464811 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:28.464869 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:28.464847 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:10:29.470513 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:29.470477 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerStarted","Data":"8e37e800ef0d14f5bc7b3464680fa48baf73ae97c09c391ff043aaf800074b87"} Jul 07 00:10:30.298894 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:30.298860 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:30.299180 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:30.299156 2600 patch_prober.go:28] interesting pod/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 00:10:30.299234 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:30.299204 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 00:10:30.897712 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:30.897674 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:10:31.299269 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:31.299219 2600 patch_prober.go:28] interesting pod/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 00:10:31.299487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:31.299289 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 00:10:32.298788 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:32.298752 2600 patch_prober.go:28] interesting pod/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 00:10:32.299330 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:32.298833 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 00:10:33.302368 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:33.302337 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:33.302835 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:33.302735 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:33.303331 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:33.303312 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:10:44.091829 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:44.091791 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:10:57.492075 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:10:57.492014 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:11:37.185979 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:37.185887 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:11:54.733203 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:54.733172 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:11:54.733681 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:54.733390 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" containerID="cri-o://8e37e800ef0d14f5bc7b3464680fa48baf73ae97c09c391ff043aaf800074b87" gracePeriod=30 Jul 07 00:11:58.483844 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:58.483808 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:11:59.954195 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:59.954164 2600 generic.go:356] "Generic (PLEG): container finished" podID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerID="8e37e800ef0d14f5bc7b3464680fa48baf73ae97c09c391ff043aaf800074b87" exitCode=0 Jul 07 00:11:59.954623 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:59.954235 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerDied","Data":"8e37e800ef0d14f5bc7b3464680fa48baf73ae97c09c391ff043aaf800074b87"} Jul 07 00:11:59.954623 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:59.954315 2600 scope.go:117] "RemoveContainer" containerID="c0150db42363a34df97bab3edcdac6b1cae4f5f9e44e19c998beb93183bcc7f2" Jul 07 00:11:59.995069 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:11:59.994996 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:12:00.178446 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178411 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178446 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178446 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178479 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178502 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178546 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178569 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178918 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178753 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:00.178918 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178772 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmpdf\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178918 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178818 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.178918 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178846 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket\") pod \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\" (UID: \"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12\") " Jul 07 00:12:00.179154 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178936 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:00.179154 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.178944 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:12:00.179433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.179175 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:00.179433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.179249 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.179433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.179271 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.179433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.179286 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.179433 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.179309 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:00.180985 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.180936 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:12:00.180985 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.180951 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:12:00.181153 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.181008 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf" (OuterVolumeSpecName: "kube-api-access-dmpdf") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "kube-api-access-dmpdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:12:00.181195 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.181179 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" (UID: "6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279593 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279623 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279632 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279643 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmpdf\" (UniqueName: \"kubernetes.io/projected/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-kube-api-access-dmpdf\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279651 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.279698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.279662 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:12:00.960802 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.960768 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" Jul 07 00:12:00.961313 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.960800 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr" event={"ID":"6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12","Type":"ContainerDied","Data":"7e763ab64dffd1153178023c74b745765ea10646fd1f49218f6f6c31a2d91beb"} Jul 07 00:12:00.961313 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.960868 2600 scope.go:117] "RemoveContainer" containerID="8e37e800ef0d14f5bc7b3464680fa48baf73ae97c09c391ff043aaf800074b87" Jul 07 00:12:00.983332 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.983304 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:12:00.987551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:00.987522 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-522f0b74-openshift-default-7d6d6997c9-c77gr"] Jul 07 00:12:01.822761 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:01.822727 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" path="/var/lib/kubelet/pods/6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12/volumes" Jul 07 00:12:10.086041 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:10.086006 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:12:49.888407 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888352 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:12:49.888860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888747 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:49.888860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888759 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:49.888860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888817 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:49.888860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888826 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="937c877c-f054-4e92-b2ed-354e66857dd6" containerName="istio-proxy" Jul 07 00:12:49.888860 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.888832 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:49.891965 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.891944 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:49.894715 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.894697 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-02e2a5-openshift-default-dockercfg-klf4g\"" Jul 07 00:12:49.903540 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:49.903516 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:12:50.010423 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010388 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010423 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010420 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010482 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010612 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010644 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010676 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010888 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010719 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010888 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010748 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.010888 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.010771 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvnlw\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111448 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111414 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111484 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111509 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111528 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111556 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111584 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111627 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111608 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvnlw\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111929 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111661 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111929 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111683 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111929 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111870 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.111929 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111895 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.112223 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.111955 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.112223 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.112077 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.112373 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.112356 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.114665 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.114642 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.115726 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.115671 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.119947 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.119925 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvnlw\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.120094 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.119992 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token\") pod \"e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.203535 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.203431 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:50.355908 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.355881 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:12:50.358818 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:12:50.358786 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb448e26_6b89_43e7_8334_aea9e1025558.slice/crio-d0f6dfe33724183471a71a89a5017ff428bd7e7ecf891b0ca1a79b99e72884cb WatchSource:0}: Error finding container d0f6dfe33724183471a71a89a5017ff428bd7e7ecf891b0ca1a79b99e72884cb: Status 404 returned error can't find the container with id d0f6dfe33724183471a71a89a5017ff428bd7e7ecf891b0ca1a79b99e72884cb Jul 07 00:12:50.360890 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.360856 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:50.360970 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.360926 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:50.360970 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:50.360954 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:51.238244 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:51.238211 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerStarted","Data":"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc"} Jul 07 00:12:51.238642 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:51.238291 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerStarted","Data":"d0f6dfe33724183471a71a89a5017ff428bd7e7ecf891b0ca1a79b99e72884cb"} Jul 07 00:12:51.258448 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:51.258289 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podStartSLOduration=2.2582707539999998 podStartE2EDuration="2.258270754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:12:51.257826736 +0000 UTC m=+1811.958587555" watchObservedRunningTime="2026-07-07 00:12:51.258270754 +0000 UTC m=+1811.959031573" Jul 07 00:12:52.203766 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:52.203729 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:52.208746 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:52.208721 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:52.244508 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:52.244473 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:52.245601 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:52.245573 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:12:58.432829 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.432796 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:12:58.433310 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.433277 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:58.433310 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.433293 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b30f0ab-3ad4-4e3a-a57c-b5472ef40e12" containerName="istio-proxy" Jul 07 00:12:58.436702 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.436678 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.439606 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.439585 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b40adc-openshift-default-dockercfg-v6m4x\"" Jul 07 00:12:58.450034 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.450006 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:12:58.589489 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589440 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589489 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589494 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589585 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589615 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589737 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589655 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589750 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589783 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589817 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.589842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.589832 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691285 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691158 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691285 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691262 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691298 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691338 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691361 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691407 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691433 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691489 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691545 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691517 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691895 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691640 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691895 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691739 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.691895 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691777 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.692041 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691900 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.692041 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.691995 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.694148 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.694119 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.694334 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.694314 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.700117 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.700089 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.700230 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.700174 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr\") pod \"e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.749583 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.749546 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:58.894909 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.894879 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:12:58.896291 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:12:58.896262 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d9e6e2_8e3c_4966_9625_babad3f63a21.slice/crio-7eed7666113d2df264f4d0991a03e7e5d1b02b96658afb17f4a282d4cdf5f415 WatchSource:0}: Error finding container 7eed7666113d2df264f4d0991a03e7e5d1b02b96658afb17f4a282d4cdf5f415: Status 404 returned error can't find the container with id 7eed7666113d2df264f4d0991a03e7e5d1b02b96658afb17f4a282d4cdf5f415 Jul 07 00:12:58.898276 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.898244 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:58.898355 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.898316 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:58.898355 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:58.898344 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:12:59.282865 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.282826 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerStarted","Data":"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252"} Jul 07 00:12:59.283067 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.282892 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerStarted","Data":"7eed7666113d2df264f4d0991a03e7e5d1b02b96658afb17f4a282d4cdf5f415"} Jul 07 00:12:59.306607 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.306554 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podStartSLOduration=1.306535898 podStartE2EDuration="1.306535898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:12:59.304663487 +0000 UTC m=+1820.005424333" watchObservedRunningTime="2026-07-07 00:12:59.306535898 +0000 UTC m=+1820.007296717" Jul 07 00:12:59.486498 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.486462 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:12:59.749760 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.749722 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:12:59.754954 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:12:59.754929 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:00.288920 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:00.288890 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:00.290076 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:00.290031 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:07.357963 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:07.357933 2600 patch_prober.go:28] interesting pod/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:48748->10.133.0.50:15021: read: connection reset by peer" start-of-body= Jul 07 00:13:07.358398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:07.357998 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:48748->10.133.0.50:15021: read: connection reset by peer" Jul 07 00:13:08.344278 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.344234 2600 generic.go:356] "Generic (PLEG): container finished" podID="cb448e26-6b89-43e7-8334-aea9e1025558" containerID="65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc" exitCode=0 Jul 07 00:13:08.344499 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.344431 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerDied","Data":"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc"} Jul 07 00:13:08.344930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.344906 2600 scope.go:117] "RemoveContainer" containerID="65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc" Jul 07 00:13:08.346245 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.346205 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:08.346351 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.346303 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:08.346414 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:08.346349 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:09.356088 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:09.355677 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerStarted","Data":"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1"} Jul 07 00:13:10.204230 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:10.204195 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:13:10.204486 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:10.204451 2600 patch_prober.go:28] interesting pod/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 00:13:10.204596 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:10.204529 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 00:13:11.204440 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:11.204405 2600 patch_prober.go:28] interesting pod/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 00:13:11.204892 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:11.204475 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 00:13:12.204695 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:12.204651 2600 patch_prober.go:28] interesting pod/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 00:13:12.205140 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:12.204727 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 00:13:13.207961 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:13.207933 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:13:13.208391 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:13.208332 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:13:13.209079 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:13.209036 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:13:14.791141 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:14.785853 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:13:15.291001 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.290964 2600 patch_prober.go:28] interesting pod/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 00:13:15.291206 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.291034 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 00:13:15.392738 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.392702 2600 generic.go:356] "Generic (PLEG): container finished" podID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerID="d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252" exitCode=0 Jul 07 00:13:15.392905 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.392774 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerDied","Data":"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252"} Jul 07 00:13:15.393230 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.393214 2600 scope.go:117] "RemoveContainer" containerID="d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252" Jul 07 00:13:15.394324 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.394297 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:15.394390 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.394379 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:15.394427 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:15.394412 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:13:16.399810 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:16.399778 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerStarted","Data":"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0"} Jul 07 00:13:16.750023 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:16.749976 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:16.750397 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:16.750365 2600 patch_prober.go:28] interesting pod/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 00:13:16.750530 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:16.750430 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 00:13:17.750589 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:17.750551 2600 patch_prober.go:28] interesting pod/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 00:13:17.751161 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:17.750706 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 00:13:18.751024 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:18.750988 2600 patch_prober.go:28] interesting pod/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 00:13:18.751596 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:18.751531 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 00:13:19.750402 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:19.750361 2600 patch_prober.go:28] interesting pod/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 00:13:19.750623 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:19.750422 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 00:13:20.754551 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:20.754521 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:20.755004 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:20.754972 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:20.755749 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:20.755732 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:13:26.784255 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:26.784220 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:13:36.088318 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:36.088285 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:13:51.486727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:13:51.486689 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:14:07.082978 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:07.082896 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:14:38.018815 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:38.018779 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:14:38.019448 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:38.019026 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" containerID="cri-o://4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1" gracePeriod=30 Jul 07 00:14:42.182192 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:42.182156 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:14:43.274298 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.274271 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:14:43.366802 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366707 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvnlw\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.366802 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366751 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.366802 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366771 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.366802 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366802 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366843 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366873 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366896 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366951 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.366997 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket\") pod \"cb448e26-6b89-43e7-8334-aea9e1025558\" (UID: \"cb448e26-6b89-43e7-8334-aea9e1025558\") " Jul 07 00:14:43.367422 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.367251 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:43.367422 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.367365 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:14:43.367538 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.367467 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:43.367845 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.367820 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:43.367937 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.367913 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:43.369193 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.369168 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw" (OuterVolumeSpecName: "kube-api-access-cvnlw") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "kube-api-access-cvnlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:14:43.369319 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.369237 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:43.369390 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.369358 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:14:43.369585 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.369570 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb448e26-6b89-43e7-8334-aea9e1025558" (UID: "cb448e26-6b89-43e7-8334-aea9e1025558"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:14:43.468398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468361 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468394 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvnlw\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-kube-api-access-cvnlw\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468398 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468408 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468420 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468434 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468448 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb448e26-6b89-43e7-8334-aea9e1025558-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468458 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb448e26-6b89-43e7-8334-aea9e1025558-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468467 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb448e26-6b89-43e7-8334-aea9e1025558-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.468661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.468477 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb448e26-6b89-43e7-8334-aea9e1025558-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:43.879976 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.879942 2600 generic.go:356] "Generic (PLEG): container finished" podID="cb448e26-6b89-43e7-8334-aea9e1025558" containerID="4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1" exitCode=0 Jul 07 00:14:43.880177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.879986 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" Jul 07 00:14:43.880177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.880033 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerDied","Data":"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1"} Jul 07 00:14:43.880177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.880109 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" event={"ID":"cb448e26-6b89-43e7-8334-aea9e1025558","Type":"ContainerDied","Data":"d0f6dfe33724183471a71a89a5017ff428bd7e7ecf891b0ca1a79b99e72884cb"} Jul 07 00:14:43.880177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.880137 2600 scope.go:117] "RemoveContainer" containerID="4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1" Jul 07 00:14:43.889487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.889471 2600 scope.go:117] "RemoveContainer" containerID="65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc" Jul 07 00:14:43.898031 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.897989 2600 scope.go:117] "RemoveContainer" containerID="4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1" Jul 07 00:14:43.898541 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:14:43.898426 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1\": container with ID starting with 4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1 not found: ID does not exist" containerID="4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1" Jul 07 00:14:43.898541 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.898464 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1"} err="failed to get container status \"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1\": rpc error: code = NotFound desc = could not find container \"4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1\": container with ID starting with 4e14d0fce4e09add4d25b7943693ed5c55a810a844816576d71ee66f7e42c3f1 not found: ID does not exist" Jul 07 00:14:43.898541 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.898488 2600 scope.go:117] "RemoveContainer" containerID="65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc" Jul 07 00:14:43.898787 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:14:43.898770 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc\": container with ID starting with 65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc not found: ID does not exist" containerID="65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc" Jul 07 00:14:43.898828 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.898795 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc"} err="failed to get container status \"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc\": rpc error: code = NotFound desc = could not find container \"65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc\": container with ID starting with 65c8f007c72477c7860c33bb5ecf75d2c89c9a038ca6332c54c5acb1a16d85bc not found: ID does not exist" Jul 07 00:14:43.900897 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.900871 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:14:43.904395 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:43.904373 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp"] Jul 07 00:14:44.209762 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:44.209660 2600 patch_prober.go:28] interesting pod/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 00:14:44.209762 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:44.209738 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-02e2a5-openshift-default-7d986df987-vczcp" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 00:14:45.273653 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:45.273621 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:14:45.274116 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:45.273837 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" containerID="cri-o://8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0" gracePeriod=30 Jul 07 00:14:45.823517 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:45.823484 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" path="/var/lib/kubelet/pods/cb448e26-6b89-43e7-8334-aea9e1025558/volumes" Jul 07 00:14:46.176290 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.176215 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:14:46.176572 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.176560 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:46.176628 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.176574 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:46.176664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.176635 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:46.176664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.176642 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:46.179492 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.179476 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.182062 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.182027 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1d88cc-openshift-default-dockercfg-ksvsg\"" Jul 07 00:14:46.190851 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.190826 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:14:46.294759 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.294726 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.294769 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.294817 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbr2\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.294906 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.294960 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.295002 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.295041 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.295128 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.295201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.295183 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396185 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396155 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396369 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396204 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396369 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396238 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396369 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396278 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbr2\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396369 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396321 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396455 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396501 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396569 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396546 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396602 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396637 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396727 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396691 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396883 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396723 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.396938 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.396915 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.397272 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.397246 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.398764 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.398740 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.399307 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.399288 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.405179 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.405158 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.405783 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.405761 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbr2\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2\") pod \"e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.491584 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.491546 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:46.640629 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.640591 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:14:46.641975 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:14:46.641946 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f1b3ad_ff95_4ea9_9569_acd5ce903972.slice/crio-8f32e0a6ba959f4d382e6a9960d7d3e0142c8983f929ddd9cc87f172c701262f WatchSource:0}: Error finding container 8f32e0a6ba959f4d382e6a9960d7d3e0142c8983f929ddd9cc87f172c701262f: Status 404 returned error can't find the container with id 8f32e0a6ba959f4d382e6a9960d7d3e0142c8983f929ddd9cc87f172c701262f Jul 07 00:14:46.644297 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.644250 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:46.644369 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.644338 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:46.644406 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.644380 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:46.899263 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.899165 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerStarted","Data":"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0"} Jul 07 00:14:46.899263 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.899221 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerStarted","Data":"8f32e0a6ba959f4d382e6a9960d7d3e0142c8983f929ddd9cc87f172c701262f"} Jul 07 00:14:46.921731 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:46.921680 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podStartSLOduration=0.92166551 podStartE2EDuration="921.66551ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:46.91874043 +0000 UTC m=+1927.619501273" watchObservedRunningTime="2026-07-07 00:14:46.92166551 +0000 UTC m=+1927.622426330" Jul 07 00:14:47.492063 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:47.492013 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:47.497429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:47.497406 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:47.904847 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:47.904761 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:47.905759 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:47.905741 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:14:50.304372 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:14:50.304334 2600 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d9e6e2_8e3c_4966_9625_babad3f63a21.slice/crio-conmon-8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d9e6e2_8e3c_4966_9625_babad3f63a21.slice/crio-8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0.scope\": RecentStats: unable to find data in memory cache]" Jul 07 00:14:50.534479 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.534400 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:14:50.635244 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635203 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635271 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635304 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635325 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635391 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635421 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635693 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635463 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635693 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635495 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635693 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635520 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs\") pod \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\" (UID: \"d7d9e6e2-8e3c-4966-9625-babad3f63a21\") " Jul 07 00:14:50.635693 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635528 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:50.635693 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635642 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:50.635956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635832 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:50.635956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635875 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.635956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635893 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.635956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.635907 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:14:50.636277 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.636246 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:50.637980 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.637956 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:14:50.638235 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.638216 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:14:50.638401 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.638374 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:14:50.638500 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.638477 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr" (OuterVolumeSpecName: "kube-api-access-xvxxr") pod "d7d9e6e2-8e3c-4966-9625-babad3f63a21" (UID: "d7d9e6e2-8e3c-4966-9625-babad3f63a21"). InnerVolumeSpecName "kube-api-access-xvxxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:14:50.737286 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737244 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-kube-api-access-xvxxr\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737286 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737285 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737299 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737311 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737322 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737333 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.737501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.737343 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7d9e6e2-8e3c-4966-9625-babad3f63a21-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:14:50.923752 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.923658 2600 generic.go:356] "Generic (PLEG): container finished" podID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerID="8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0" exitCode=0 Jul 07 00:14:50.923752 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.923712 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" Jul 07 00:14:50.923752 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.923727 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerDied","Data":"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0"} Jul 07 00:14:50.924023 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.923769 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7" event={"ID":"d7d9e6e2-8e3c-4966-9625-babad3f63a21","Type":"ContainerDied","Data":"7eed7666113d2df264f4d0991a03e7e5d1b02b96658afb17f4a282d4cdf5f415"} Jul 07 00:14:50.924023 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.923789 2600 scope.go:117] "RemoveContainer" containerID="8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0" Jul 07 00:14:50.933972 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.933950 2600 scope.go:117] "RemoveContainer" containerID="d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252" Jul 07 00:14:50.943342 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.943324 2600 scope.go:117] "RemoveContainer" containerID="8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0" Jul 07 00:14:50.943611 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:14:50.943588 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0\": container with ID starting with 8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0 not found: ID does not exist" containerID="8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0" Jul 07 00:14:50.943661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.943620 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0"} err="failed to get container status \"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0\": rpc error: code = NotFound desc = could not find container \"8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0\": container with ID starting with 8dbf3efa8c3e55221cd885c0642c642703aa7f0b80d9fe092270a1cda5a326b0 not found: ID does not exist" Jul 07 00:14:50.943661 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.943637 2600 scope.go:117] "RemoveContainer" containerID="d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252" Jul 07 00:14:50.943880 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:14:50.943862 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252\": container with ID starting with d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252 not found: ID does not exist" containerID="d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252" Jul 07 00:14:50.943918 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.943886 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252"} err="failed to get container status \"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252\": rpc error: code = NotFound desc = could not find container \"d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252\": container with ID starting with d039e946bed5bd822d2a6762e8ae40db014b6d5c0b90e6c996739d25a8bf8252 not found: ID does not exist" Jul 07 00:14:50.948875 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.948852 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:14:50.952950 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:50.952926 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b40adc-openshift-default-55766678dc-ddpx7"] Jul 07 00:14:51.822769 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:51.822730 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" path="/var/lib/kubelet/pods/d7d9e6e2-8e3c-4966-9625-babad3f63a21/volumes" Jul 07 00:14:54.211497 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.211449 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:14:54.212010 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.211982 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:54.212010 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212005 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb448e26-6b89-43e7-8334-aea9e1025558" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212016 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212025 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212038 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212044 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212122 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.212238 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.212130 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d9e6e2-8e3c-4966-9625-babad3f63a21" containerName="istio-proxy" Jul 07 00:14:54.215112 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.215092 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.217815 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.217793 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-179c25-openshift-default-dockercfg-9t6rz\"" Jul 07 00:14:54.228299 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.228272 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:14:54.269461 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269427 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269674 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269467 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269674 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269494 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkdlq\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269674 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269589 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269674 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269638 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269890 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269693 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269890 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269758 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269890 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269784 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.269890 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.269878 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371016 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.370976 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371016 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371016 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371073 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371104 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371125 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371143 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkdlq\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371167 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371186 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371220 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371633 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371549 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371633 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371614 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371713 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371653 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371907 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371886 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.371956 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.371909 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.373636 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.373607 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.373986 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.373971 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.379149 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.379126 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.379427 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.379408 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkdlq\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq\") pod \"e2e-api-b-179c25-openshift-default-698764f8dc-cczdp\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.525224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.525195 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:54.668574 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.668546 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:14:54.670091 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:14:54.670039 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca29820_932a_49f8_b24d_3a9a8be4358b.slice/crio-a48852a3a053f146916489aba8886a9f9e44e003370f7d2d4ba5fac977e1b640 WatchSource:0}: Error finding container a48852a3a053f146916489aba8886a9f9e44e003370f7d2d4ba5fac977e1b640: Status 404 returned error can't find the container with id a48852a3a053f146916489aba8886a9f9e44e003370f7d2d4ba5fac977e1b640 Jul 07 00:14:54.672258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.672224 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:54.672352 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.672297 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:54.672352 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.672327 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:14:54.956210 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.956114 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerStarted","Data":"996c4a861255e91bee2c54e9af6f72bf9b1c0c2c7b5ddc2f50138d88695a349a"} Jul 07 00:14:54.956210 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.956202 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerStarted","Data":"a48852a3a053f146916489aba8886a9f9e44e003370f7d2d4ba5fac977e1b640"} Jul 07 00:14:54.979079 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:54.978920 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podStartSLOduration=0.97887759 podStartE2EDuration="978.87759ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:54.976178647 +0000 UTC m=+1935.676939484" watchObservedRunningTime="2026-07-07 00:14:54.97887759 +0000 UTC m=+1935.679638411" Jul 07 00:14:55.525345 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:55.525308 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:55.530923 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:55.530897 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:55.962190 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:55.962099 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:55.963345 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:55.963326 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:14:56.790109 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:14:56.790070 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:15:00.139086 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.139027 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-tn4f7"] Jul 07 00:15:00.143263 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.143222 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:00.146015 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.144310 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:00.151127 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.149905 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p"] Jul 07 00:15:00.151982 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.151961 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:00.152263 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.152010 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\"" Jul 07 00:15:00.154092 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.154071 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:00.160407 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.160373 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-tn4f7"] Jul 07 00:15:00.164313 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.164216 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p"] Jul 07 00:15:00.171349 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.171216 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:00.233080 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.231594 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzq7\" (UniqueName: \"kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7\") pod \"maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6\" (UID: \"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:00.233080 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.231671 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rsd\" (UniqueName: \"kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd\") pod \"maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p\" (UID: \"d8ccd250-9bde-46e2-bc60-a49f83b81fe9\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:00.233080 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.231742 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqts7\" (UniqueName: \"kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7\") pod \"maas-api-key-cleanup-29723055-tn4f7\" (UID: \"cb6d227e-f828-4e35-9921-3364c9a1fca8\") " pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:00.332992 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.332942 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzq7\" (UniqueName: \"kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7\") pod \"maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6\" (UID: \"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:00.333225 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.333022 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rsd\" (UniqueName: \"kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd\") pod \"maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p\" (UID: \"d8ccd250-9bde-46e2-bc60-a49f83b81fe9\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:00.333225 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.333112 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqts7\" (UniqueName: \"kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7\") pod \"maas-api-key-cleanup-29723055-tn4f7\" (UID: \"cb6d227e-f828-4e35-9921-3364c9a1fca8\") " pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:00.349080 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.345216 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqts7\" (UniqueName: \"kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7\") pod \"maas-api-key-cleanup-29723055-tn4f7\" (UID: \"cb6d227e-f828-4e35-9921-3364c9a1fca8\") " pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:00.353075 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.352191 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rsd\" (UniqueName: \"kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd\") pod \"maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p\" (UID: \"d8ccd250-9bde-46e2-bc60-a49f83b81fe9\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:00.353075 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.352794 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzq7\" (UniqueName: \"kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7\") pod \"maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6\" (UID: \"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:00.472087 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.471963 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:00.489313 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.489283 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:00.492409 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.492385 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:00.687526 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.687334 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-tn4f7"] Jul 07 00:15:00.689292 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:15:00.689258 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6d227e_f828_4e35_9921_3364c9a1fca8.slice/crio-a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d WatchSource:0}: Error finding container a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d: Status 404 returned error can't find the container with id a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d Jul 07 00:15:00.926384 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.926328 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p"] Jul 07 00:15:00.928678 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:15:00.928644 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ccd250_9bde_46e2_bc60_a49f83b81fe9.slice/crio-a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2 WatchSource:0}: Error finding container a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2: Status 404 returned error can't find the container with id a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2 Jul 07 00:15:00.970960 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.970916 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:00.973565 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:15:00.973537 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46e9c8d_30d6_4ac9_a20a_52718f11ab5d.slice/crio-f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0 WatchSource:0}: Error finding container f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0: Status 404 returned error can't find the container with id f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0 Jul 07 00:15:00.991660 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.991630 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerStarted","Data":"f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0"} Jul 07 00:15:00.993219 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.993192 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" event={"ID":"cb6d227e-f828-4e35-9921-3364c9a1fca8","Type":"ContainerStarted","Data":"a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d"} Jul 07 00:15:00.994438 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:00.994411 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" event={"ID":"d8ccd250-9bde-46e2-bc60-a49f83b81fe9","Type":"ContainerStarted","Data":"a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2"} Jul 07 00:15:02.001985 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.001943 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" event={"ID":"cb6d227e-f828-4e35-9921-3364c9a1fca8","Type":"ContainerStarted","Data":"f65f791a33f7b96659a55de4271f257c366c3af8e3f507fa2b2d188e1df364f7"} Jul 07 00:15:02.003611 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.003583 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" event={"ID":"d8ccd250-9bde-46e2-bc60-a49f83b81fe9","Type":"ContainerStarted","Data":"7f72aaa287c9ad0e2ec0844e2f82b0f9432b04219f58f47671a69b711a35c321"} Jul 07 00:15:02.005009 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.004983 2600 generic.go:356] "Generic (PLEG): container finished" podID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerID="13669c596b23a526078ecb1c212038c9a08dcd210d92ec0820f76cfb70c3735d" exitCode=7 Jul 07 00:15:02.005159 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.005034 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerDied","Data":"13669c596b23a526078ecb1c212038c9a08dcd210d92ec0820f76cfb70c3735d"} Jul 07 00:15:02.005384 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.005366 2600 scope.go:117] "RemoveContainer" containerID="13669c596b23a526078ecb1c212038c9a08dcd210d92ec0820f76cfb70c3735d" Jul 07 00:15:02.018264 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.018214 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" podStartSLOduration=2.018198008 podStartE2EDuration="2.018198008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:02.016669265 +0000 UTC m=+1942.717430089" watchObservedRunningTime="2026-07-07 00:15:02.018198008 +0000 UTC m=+1942.718958827" Jul 07 00:15:02.057799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:02.057725 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" podStartSLOduration=2.057705658 podStartE2EDuration="2.057705658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:02.053605511 +0000 UTC m=+1942.754366332" watchObservedRunningTime="2026-07-07 00:15:02.057705658 +0000 UTC m=+1942.758466456" Jul 07 00:15:03.013733 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.013699 2600 generic.go:356] "Generic (PLEG): container finished" podID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerID="15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b" exitCode=7 Jul 07 00:15:03.014224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.013794 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerDied","Data":"15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b"} Jul 07 00:15:03.014224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.013854 2600 scope.go:117] "RemoveContainer" containerID="13669c596b23a526078ecb1c212038c9a08dcd210d92ec0820f76cfb70c3735d" Jul 07 00:15:03.014224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.014085 2600 scope.go:117] "RemoveContainer" containerID="15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b" Jul 07 00:15:03.014391 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:15:03.014347 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6_opendatahub(c46e9c8d-30d6-4ac9-a20a-52718f11ab5d)\"" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" Jul 07 00:15:03.015522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.015497 2600 generic.go:356] "Generic (PLEG): container finished" podID="cb6d227e-f828-4e35-9921-3364c9a1fca8" containerID="f65f791a33f7b96659a55de4271f257c366c3af8e3f507fa2b2d188e1df364f7" exitCode=0 Jul 07 00:15:03.015624 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.015586 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" event={"ID":"cb6d227e-f828-4e35-9921-3364c9a1fca8","Type":"ContainerDied","Data":"f65f791a33f7b96659a55de4271f257c366c3af8e3f507fa2b2d188e1df364f7"} Jul 07 00:15:03.017347 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.017293 2600 generic.go:356] "Generic (PLEG): container finished" podID="d8ccd250-9bde-46e2-bc60-a49f83b81fe9" containerID="7f72aaa287c9ad0e2ec0844e2f82b0f9432b04219f58f47671a69b711a35c321" exitCode=0 Jul 07 00:15:03.017469 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.017413 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" event={"ID":"d8ccd250-9bde-46e2-bc60-a49f83b81fe9","Type":"ContainerDied","Data":"7f72aaa287c9ad0e2ec0844e2f82b0f9432b04219f58f47671a69b711a35c321"} Jul 07 00:15:03.947294 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.947248 2600 patch_prober.go:28] interesting pod/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 00:15:03.947475 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:03.947320 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 00:15:04.025602 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.025569 2600 scope.go:117] "RemoveContainer" containerID="15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b" Jul 07 00:15:04.026079 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:15:04.025789 2600 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6_opendatahub(c46e9c8d-30d6-4ac9-a20a-52718f11ab5d)\"" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" Jul 07 00:15:04.210850 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.210815 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:04.213023 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.213003 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:04.388279 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.388242 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4rsd\" (UniqueName: \"kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd\") pod \"d8ccd250-9bde-46e2-bc60-a49f83b81fe9\" (UID: \"d8ccd250-9bde-46e2-bc60-a49f83b81fe9\") " Jul 07 00:15:04.388485 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.388318 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqts7\" (UniqueName: \"kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7\") pod \"cb6d227e-f828-4e35-9921-3364c9a1fca8\" (UID: \"cb6d227e-f828-4e35-9921-3364c9a1fca8\") " Jul 07 00:15:04.390487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.390459 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7" (OuterVolumeSpecName: "kube-api-access-bqts7") pod "cb6d227e-f828-4e35-9921-3364c9a1fca8" (UID: "cb6d227e-f828-4e35-9921-3364c9a1fca8"). InnerVolumeSpecName "kube-api-access-bqts7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:04.390637 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.390601 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd" (OuterVolumeSpecName: "kube-api-access-d4rsd") pod "d8ccd250-9bde-46e2-bc60-a49f83b81fe9" (UID: "d8ccd250-9bde-46e2-bc60-a49f83b81fe9"). InnerVolumeSpecName "kube-api-access-d4rsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:04.489974 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.489937 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4rsd\" (UniqueName: \"kubernetes.io/projected/d8ccd250-9bde-46e2-bc60-a49f83b81fe9-kube-api-access-d4rsd\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:04.489974 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:04.489971 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqts7\" (UniqueName: \"kubernetes.io/projected/cb6d227e-f828-4e35-9921-3364c9a1fca8-kube-api-access-bqts7\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:05.033845 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.033813 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" Jul 07 00:15:05.033845 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.033825 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-tn4f7" event={"ID":"cb6d227e-f828-4e35-9921-3364c9a1fca8","Type":"ContainerDied","Data":"a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d"} Jul 07 00:15:05.034374 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.033885 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8b77d7422016c2a10e62da795acc515425c8f1613e3d89898f918fbcf83041d" Jul 07 00:15:05.035199 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.035173 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" event={"ID":"d8ccd250-9bde-46e2-bc60-a49f83b81fe9","Type":"ContainerDied","Data":"a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2"} Jul 07 00:15:05.035199 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.035199 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p" Jul 07 00:15:05.035348 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:05.035223 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9b39babbbaf08510889240bb802b39e6749ec4d9c7d827c1c01fb7c896d57c2" Jul 07 00:15:06.042273 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.042240 2600 generic.go:356] "Generic (PLEG): container finished" podID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerID="792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0" exitCode=0 Jul 07 00:15:06.042699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.042316 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerDied","Data":"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0"} Jul 07 00:15:06.042746 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.042702 2600 scope.go:117] "RemoveContainer" containerID="792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0" Jul 07 00:15:06.043733 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.043696 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:06.043826 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.043768 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:06.043826 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:06.043800 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:07.055502 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:07.055443 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerStarted","Data":"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e"} Jul 07 00:15:07.492513 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:07.492481 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:07.492699 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:07.492671 2600 patch_prober.go:28] interesting pod/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 00:15:07.492753 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:07.492732 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 00:15:08.492750 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:08.492712 2600 patch_prober.go:28] interesting pod/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 00:15:08.493204 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:08.492768 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 00:15:09.492837 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:09.492809 2600 patch_prober.go:28] interesting pod/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 00:15:09.493321 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:09.492861 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 00:15:10.492959 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:10.492924 2600 patch_prober.go:28] interesting pod/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 00:15:10.493468 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:10.493121 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 00:15:10.606987 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:10.606955 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p"] Jul 07 00:15:10.609615 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:10.609592 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-1d88cc-29723055-w9h2p"] Jul 07 00:15:11.496508 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:11.496478 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:11.496979 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:11.496879 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:11.497849 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:11.497828 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:11.824846 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:11.824761 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ccd250-9bde-46e2-bc60-a49f83b81fe9" path="/var/lib/kubelet/pods/d8ccd250-9bde-46e2-bc60-a49f83b81fe9/volumes" Jul 07 00:15:12.003295 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:12.003255 2600 patch_prober.go:28] interesting pod/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 00:15:12.003511 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:12.003326 2600 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 00:15:13.184402 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:13.184372 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:15:14.109579 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.109546 2600 generic.go:356] "Generic (PLEG): container finished" podID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerID="996c4a861255e91bee2c54e9af6f72bf9b1c0c2c7b5ddc2f50138d88695a349a" exitCode=0 Jul 07 00:15:14.109787 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.109616 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerDied","Data":"996c4a861255e91bee2c54e9af6f72bf9b1c0c2c7b5ddc2f50138d88695a349a"} Jul 07 00:15:14.110036 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.110018 2600 scope.go:117] "RemoveContainer" containerID="996c4a861255e91bee2c54e9af6f72bf9b1c0c2c7b5ddc2f50138d88695a349a" Jul 07 00:15:14.111162 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.111132 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:14.111274 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.111238 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:14.111340 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.111293 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:14.817510 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:14.817475 2600 scope.go:117] "RemoveContainer" containerID="15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b" Jul 07 00:15:15.117573 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:15.117481 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerStarted","Data":"240fbe3666cfe17431eaa5ae07769acda57e76c895928b924684be7b11462dc7"} Jul 07 00:15:15.525673 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:15.525637 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:15.526345 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:15.526315 2600 patch_prober.go:28] interesting pod/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 00:15:15.526548 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:15.526521 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 00:15:16.126535 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.126491 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerStarted","Data":"740a6b1ec02726a1387e3d4a7f08230462b922a6e9e405295adb0d31dcc2c56b"} Jul 07 00:15:16.146570 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.146494 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" podStartSLOduration=16.146471056 podStartE2EDuration="16.146471056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:16.145327211 +0000 UTC m=+1956.846088032" watchObservedRunningTime="2026-07-07 00:15:16.146471056 +0000 UTC m=+1956.847231878" Jul 07 00:15:16.463676 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.463586 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:15:16.463836 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.463790 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" containerID="cri-o://14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e" gracePeriod=30 Jul 07 00:15:16.525981 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.525944 2600 patch_prober.go:28] interesting pod/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 00:15:16.526294 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:16.526262 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 00:15:17.139683 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.138746 2600 generic.go:356] "Generic (PLEG): container finished" podID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerID="740a6b1ec02726a1387e3d4a7f08230462b922a6e9e405295adb0d31dcc2c56b" exitCode=0 Jul 07 00:15:17.139683 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.138956 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerDied","Data":"740a6b1ec02726a1387e3d4a7f08230462b922a6e9e405295adb0d31dcc2c56b"} Jul 07 00:15:17.139683 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.139017 2600 scope.go:117] "RemoveContainer" containerID="15282bc98d4296f61d7d30478c148f02716da1bed34624c71e96978943bdec6b" Jul 07 00:15:17.160077 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.159979 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:17.530154 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.530115 2600 patch_prober.go:28] interesting pod/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 00:15:17.530359 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:17.530243 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 00:15:18.310132 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.310110 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:18.320784 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.320762 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wzq7\" (UniqueName: \"kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7\") pod \"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d\" (UID: \"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d\") " Jul 07 00:15:18.322912 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.322887 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7" (OuterVolumeSpecName: "kube-api-access-2wzq7") pod "c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" (UID: "c46e9c8d-30d6-4ac9-a20a-52718f11ab5d"). InnerVolumeSpecName "kube-api-access-2wzq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:18.421656 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.421561 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wzq7\" (UniqueName: \"kubernetes.io/projected/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d-kube-api-access-2wzq7\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:18.526563 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.526521 2600 patch_prober.go:28] interesting pod/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 07 00:15:18.526815 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:18.526782 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 07 00:15:19.160754 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.160726 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" Jul 07 00:15:19.160944 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.160728 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6" event={"ID":"c46e9c8d-30d6-4ac9-a20a-52718f11ab5d","Type":"ContainerDied","Data":"f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0"} Jul 07 00:15:19.160944 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.160854 2600 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f78b30a7391f729dd3dd710c4606c22eb4efde8973486d1038fec89f481c44b0" Jul 07 00:15:19.188698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.188666 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:19.191042 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.191016 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-179c25-29723055-w24z6"] Jul 07 00:15:19.530034 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.530003 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:19.530455 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.530324 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:19.531165 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.531147 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:19.822925 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:19.822834 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" path="/var/lib/kubelet/pods/c46e9c8d-30d6-4ac9-a20a-52718f11ab5d/volumes" Jul 07 00:15:21.731399 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.731376 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:21.747172 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747139 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747187 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747217 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747242 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747291 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmbr2\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747321 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747345 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747682 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747371 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747682 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747399 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data\") pod \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\" (UID: \"91f1b3ad-ff95-4ea9-9569-acd5ce903972\") " Jul 07 00:15:21.747682 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747641 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:21.747682 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747624 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:21.747881 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747705 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:15:21.747938 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.747905 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:21.748345 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.748321 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data" (OuterVolumeSpecName: "istio-data") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:21.749556 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.749532 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:15:21.749746 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.749720 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2" (OuterVolumeSpecName: "kube-api-access-gmbr2") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "kube-api-access-gmbr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:21.750196 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.750165 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:21.750286 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.750208 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token" (OuterVolumeSpecName: "istio-token") pod "91f1b3ad-ff95-4ea9-9569-acd5ce903972" (UID: "91f1b3ad-ff95-4ea9-9569-acd5ce903972"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:21.848198 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848153 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmbr2\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-kube-api-access-gmbr2\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848198 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848188 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848198 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848201 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848213 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848224 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848306 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848319 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848331 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f1b3ad-ff95-4ea9-9569-acd5ce903972-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:21.848450 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:21.848342 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f1b3ad-ff95-4ea9-9569-acd5ce903972-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:22.184234 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.184140 2600 generic.go:356] "Generic (PLEG): container finished" podID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerID="14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e" exitCode=0 Jul 07 00:15:22.184234 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.184185 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerDied","Data":"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e"} Jul 07 00:15:22.184234 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.184197 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" Jul 07 00:15:22.184534 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.184252 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc" event={"ID":"91f1b3ad-ff95-4ea9-9569-acd5ce903972","Type":"ContainerDied","Data":"8f32e0a6ba959f4d382e6a9960d7d3e0142c8983f929ddd9cc87f172c701262f"} Jul 07 00:15:22.184534 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.184273 2600 scope.go:117] "RemoveContainer" containerID="14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e" Jul 07 00:15:22.193485 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.193465 2600 scope.go:117] "RemoveContainer" containerID="792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0" Jul 07 00:15:22.203704 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.203679 2600 scope.go:117] "RemoveContainer" containerID="14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e" Jul 07 00:15:22.204587 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:15:22.204546 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e\": container with ID starting with 14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e not found: ID does not exist" containerID="14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e" Jul 07 00:15:22.204691 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.204590 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e"} err="failed to get container status \"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e\": rpc error: code = NotFound desc = could not find container \"14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e\": container with ID starting with 14a68f2f94f2e6ef037cf84cfe59e833923da7323013e96cd7d092254e785e4e not found: ID does not exist" Jul 07 00:15:22.204691 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.204616 2600 scope.go:117] "RemoveContainer" containerID="792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0" Jul 07 00:15:22.204952 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:15:22.204924 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0\": container with ID starting with 792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0 not found: ID does not exist" containerID="792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0" Jul 07 00:15:22.205499 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.204959 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:15:22.205499 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.204958 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0"} err="failed to get container status \"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0\": rpc error: code = NotFound desc = could not find container \"792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0\": container with ID starting with 792cc9498e1641b60ecc571fa7d2cddcdbb5047a7dd5c025c5903cfae76d2bc0 not found: ID does not exist" Jul 07 00:15:22.207481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:22.207457 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1d88cc-openshift-default-c9c5859c-mvdbc"] Jul 07 00:15:23.101726 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.101686 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:15:23.102207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.101939 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" containerID="cri-o://240fbe3666cfe17431eaa5ae07769acda57e76c895928b924684be7b11462dc7" gracePeriod=30 Jul 07 00:15:23.822776 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.822742 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" path="/var/lib/kubelet/pods/91f1b3ad-ff95-4ea9-9569-acd5ce903972/volumes" Jul 07 00:15:23.976555 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976520 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:15:23.976878 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976866 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976880 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976895 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976900 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976906 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976911 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976921 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.976930 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976927 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976933 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976937 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976951 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ccd250-9bde-46e2-bc60-a49f83b81fe9" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976956 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ccd250-9bde-46e2-bc60-a49f83b81fe9" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976963 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6d227e-f828-4e35-9921-3364c9a1fca8" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.976968 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6d227e-f828-4e35-9921-3364c9a1fca8" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977018 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977025 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977033 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f1b3ad-ff95-4ea9-9569-acd5ce903972" containerName="istio-proxy" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977040 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6d227e-f828-4e35-9921-3364c9a1fca8" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977045 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:23.977207 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.977067 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ccd250-9bde-46e2-bc60-a49f83b81fe9" containerName="cleanup" Jul 07 00:15:23.981834 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.981812 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:23.984281 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.984259 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-aedad1-openshift-default-dockercfg-s5trs\"" Jul 07 00:15:23.991447 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:23.991422 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:15:24.066656 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066619 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.066874 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066677 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.066874 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066721 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.066874 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066751 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.066874 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066824 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.067139 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066886 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.067139 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066912 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbpws\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.067139 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.066954 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.067139 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.067007 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.167806 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167723 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.167806 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167758 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbpws\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.167806 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167786 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.167806 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167806 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167836 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167861 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167885 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.167907 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168109 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168272 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168293 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168316 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168748 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168485 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.168748 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.168671 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.170348 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.170328 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.170487 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.170467 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.175954 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.175930 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.176088 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.176030 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbpws\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws\") pod \"e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.294101 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.294034 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:24.439680 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.439640 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:15:24.440544 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:15:24.440514 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e30cc9d_b0c5_4bd2_8ad9_681522411acf.slice/crio-6e11c8413c327036a6906fe148b2f60494afa00ff2ccc8c6a40c94b4f756e9ba WatchSource:0}: Error finding container 6e11c8413c327036a6906fe148b2f60494afa00ff2ccc8c6a40c94b4f756e9ba: Status 404 returned error can't find the container with id 6e11c8413c327036a6906fe148b2f60494afa00ff2ccc8c6a40c94b4f756e9ba Jul 07 00:15:24.442666 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.442631 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:24.442760 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.442715 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:24.442760 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:24.442743 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:25.206883 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:25.206849 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerStarted","Data":"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23"} Jul 07 00:15:25.207295 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:25.206908 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerStarted","Data":"6e11c8413c327036a6906fe148b2f60494afa00ff2ccc8c6a40c94b4f756e9ba"} Jul 07 00:15:25.230767 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:25.230714 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podStartSLOduration=2.230698308 podStartE2EDuration="2.230698308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:25.227415863 +0000 UTC m=+1965.928176684" watchObservedRunningTime="2026-07-07 00:15:25.230698308 +0000 UTC m=+1965.931459125" Jul 07 00:15:25.294252 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:25.294216 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:25.299373 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:25.299343 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:26.083739 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:26.083704 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:15:26.212309 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:26.212268 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:26.213252 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:26.213231 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:28.225767 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.225734 2600 generic.go:356] "Generic (PLEG): container finished" podID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerID="240fbe3666cfe17431eaa5ae07769acda57e76c895928b924684be7b11462dc7" exitCode=0 Jul 07 00:15:28.226216 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.225808 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerDied","Data":"240fbe3666cfe17431eaa5ae07769acda57e76c895928b924684be7b11462dc7"} Jul 07 00:15:28.226216 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.225878 2600 scope.go:117] "RemoveContainer" containerID="996c4a861255e91bee2c54e9af6f72bf9b1c0c2c7b5ddc2f50138d88695a349a" Jul 07 00:15:28.368078 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.367984 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:28.405736 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405709 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.405903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405744 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.405903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405771 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkdlq\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.405903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405801 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.405903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405851 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.405903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405887 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.406186 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405912 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.406186 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405951 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.406186 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.405972 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy\") pod \"aca29820-932a-49f8-b24d-3a9a8be4358b\" (UID: \"aca29820-932a-49f8-b24d-3a9a8be4358b\") " Jul 07 00:15:28.406186 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406037 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:28.406426 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406264 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.406426 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406265 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:28.406592 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406569 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:28.406674 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406655 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:15:28.406963 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.406910 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data" (OuterVolumeSpecName: "istio-data") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:28.408415 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.408394 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token" (OuterVolumeSpecName: "istio-token") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:28.408664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.408647 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq" (OuterVolumeSpecName: "kube-api-access-bkdlq") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "kube-api-access-bkdlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:15:28.408742 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.408699 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:15:28.408797 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.408756 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aca29820-932a-49f8-b24d-3a9a8be4358b" (UID: "aca29820-932a-49f8-b24d-3a9a8be4358b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:15:28.506934 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506904 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.506934 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506928 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkdlq\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-kube-api-access-bkdlq\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.506934 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506938 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca29820-932a-49f8-b24d-3a9a8be4358b-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.507213 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506947 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.507213 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506955 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.507213 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506963 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.507213 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506971 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:28.507213 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:28.506978 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca29820-932a-49f8-b24d-3a9a8be4358b-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:15:29.232976 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.232946 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" Jul 07 00:15:29.233470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.232998 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp" event={"ID":"aca29820-932a-49f8-b24d-3a9a8be4358b","Type":"ContainerDied","Data":"a48852a3a053f146916489aba8886a9f9e44e003370f7d2d4ba5fac977e1b640"} Jul 07 00:15:29.233470 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.233084 2600 scope.go:117] "RemoveContainer" containerID="240fbe3666cfe17431eaa5ae07769acda57e76c895928b924684be7b11462dc7" Jul 07 00:15:29.258366 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.258321 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:15:29.262783 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.262728 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-179c25-openshift-default-698764f8dc-cczdp"] Jul 07 00:15:29.823118 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:29.823086 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" path="/var/lib/kubelet/pods/aca29820-932a-49f8-b24d-3a9a8be4358b/volumes" Jul 07 00:15:32.451150 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451003 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451629 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451655 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451674 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451683 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451768 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451780 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46e9c8d-30d6-4ac9-a20a-52718f11ab5d" containerName="cleanup" Jul 07 00:15:32.452085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.451790 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca29820-932a-49f8-b24d-3a9a8be4358b" containerName="istio-proxy" Jul 07 00:15:32.456887 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.456863 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.461447 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.461427 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-72fa7c-openshift-default-dockercfg-6zgrc\"" Jul 07 00:15:32.473798 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.473770 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:15:32.547381 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.547344 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.547706 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.547681 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.547869 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.547852 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548031 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548016 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548220 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548203 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548380 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548365 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548485 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548472 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwzv\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548606 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548590 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.548749 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.548736 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.649779 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.649735 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650538 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650515 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htwzv\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650669 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650556 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650669 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650453 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650669 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650636 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650686 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650720 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650948 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650850 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.650948 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650910 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.651096 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650970 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.651096 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.650859 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.651096 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.651037 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.651395 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.651371 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.651760 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.651735 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.653200 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.653176 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.653439 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.653418 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.658989 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.658964 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.659579 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.659557 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwzv\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv\") pod \"e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.768388 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.768351 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:32.956850 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.956822 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:15:32.958472 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:15:32.958424 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf273dc73_a3c4_4ca7_ba56_c743b24269f4.slice/crio-c2f3495a9bc7336a06cf5f7a6fb6613d0ceb5311ec64ed5e7c483318ca2469c4 WatchSource:0}: Error finding container c2f3495a9bc7336a06cf5f7a6fb6613d0ceb5311ec64ed5e7c483318ca2469c4: Status 404 returned error can't find the container with id c2f3495a9bc7336a06cf5f7a6fb6613d0ceb5311ec64ed5e7c483318ca2469c4 Jul 07 00:15:32.960762 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.960724 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:32.960855 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.960808 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:32.960903 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:32.960855 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:33.272520 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:33.272418 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerStarted","Data":"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc"} Jul 07 00:15:33.272520 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:33.272481 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerStarted","Data":"c2f3495a9bc7336a06cf5f7a6fb6613d0ceb5311ec64ed5e7c483318ca2469c4"} Jul 07 00:15:33.293381 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:33.293327 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podStartSLOduration=1.293311176 podStartE2EDuration="1.293311176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:33.292199278 +0000 UTC m=+1973.992960098" watchObservedRunningTime="2026-07-07 00:15:33.293311176 +0000 UTC m=+1973.994071996" Jul 07 00:15:33.768664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:33.768627 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:34.774710 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:34.774681 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:35.283192 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:35.283156 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:35.284264 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:35.284243 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:38.787807 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:38.787773 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:15:39.309035 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.308948 2600 generic.go:356] "Generic (PLEG): container finished" podID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerID="6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23" exitCode=0 Jul 07 00:15:39.309230 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.309033 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerDied","Data":"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23"} Jul 07 00:15:39.309464 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.309450 2600 scope.go:117] "RemoveContainer" containerID="6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23" Jul 07 00:15:39.310503 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.310473 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:39.310615 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.310555 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:39.310683 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:39.310613 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:40.316825 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:40.316728 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerStarted","Data":"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25"} Jul 07 00:15:41.213258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:41.213198 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:41.295746 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:41.295403 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:41.296473 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:41.296448 2600 patch_prober.go:28] interesting pod/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 00:15:41.296603 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:41.296502 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 00:15:42.295177 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:42.295136 2600 patch_prober.go:28] interesting pod/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 00:15:42.295682 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:42.295205 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 00:15:43.294745 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:43.294715 2600 patch_prober.go:28] interesting pod/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 00:15:43.294947 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:43.294830 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 00:15:44.295441 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:44.295399 2600 patch_prober.go:28] interesting pod/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 00:15:44.295839 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:44.295466 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 00:15:45.298885 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:45.298847 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:45.299902 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:45.299880 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:15:47.363565 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.363485 2600 generic.go:356] "Generic (PLEG): container finished" podID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerID="df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc" exitCode=0 Jul 07 00:15:47.363565 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.363531 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerDied","Data":"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc"} Jul 07 00:15:47.363989 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.363949 2600 scope.go:117] "RemoveContainer" containerID="df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc" Jul 07 00:15:47.364942 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.364912 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:47.365005 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.364982 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:47.365041 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:47.365015 2600 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 00:15:48.377224 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:48.377192 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerStarted","Data":"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840"} Jul 07 00:15:48.768934 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:48.768901 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:48.770178 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:48.770151 2600 patch_prober.go:28] interesting pod/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 00:15:48.770296 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:48.770204 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 00:15:49.769081 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:49.769003 2600 patch_prober.go:28] interesting pod/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 00:15:49.769582 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:49.769130 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 00:15:50.283326 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:50.283287 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:50.769251 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:50.769212 2600 patch_prober.go:28] interesting pod/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 00:15:50.769647 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:50.769271 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 00:15:51.769763 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:51.769730 2600 patch_prober.go:28] interesting pod/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 00:15:51.770199 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:51.769796 2600 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 00:15:52.772972 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:52.772941 2600 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:52.773995 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:52.773972 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:15:53.086972 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:15:53.086881 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:16:21.832290 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:16:21.832250 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:16:41.493505 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:16:41.493464 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:16:56.084326 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:16:56.084290 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:17:13.082905 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:17:13.082825 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:17:29.685819 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:17:29.685784 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:17:46.082889 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:17:46.082852 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:18:02.079170 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:18:02.079132 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:18:17.281716 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:18:17.281679 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:18:31.583902 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:18:31.583810 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:18:43.000787 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:18:43.000753 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:19:03.589174 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:19:03.589133 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:19:32.586850 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:19:32.586812 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:19:51.100698 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:19:51.100664 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:20:09.834664 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:20:09.834582 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:20:30.797592 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:20:30.797549 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:20:47.599558 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:20:47.599523 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:21:02.334671 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:02.334629 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:21:15.793363 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:15.793324 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:21:40.094184 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:40.094110 2600 scope.go:117] "RemoveContainer" containerID="740a6b1ec02726a1387e3d4a7f08230462b922a6e9e405295adb0d31dcc2c56b" Jul 07 00:21:40.102995 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:40.102974 2600 scope.go:117] "RemoveContainer" containerID="7f72aaa287c9ad0e2ec0844e2f82b0f9432b04219f58f47671a69b711a35c321" Jul 07 00:21:54.778940 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:54.778901 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:21:54.779460 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:54.779195 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" containerID="cri-o://b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25" gracePeriod=30 Jul 07 00:21:58.697888 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:21:58.697853 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pw28l"] Jul 07 00:22:00.036758 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.036732 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:22:00.148483 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148377 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148483 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148443 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148483 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148467 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148483 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148483 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148511 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148529 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148549 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbpws\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148583 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148645 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token\") pod \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\" (UID: \"5e30cc9d-b0c5-4bd2-8ad9-681522411acf\") " Jul 07 00:22:00.148820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148746 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:00.149163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148892 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:00.149163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.148904 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:00.149163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.149037 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.149163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.149095 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.149163 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.149113 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.149405 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.149270 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:22:00.149650 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.149619 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:00.150914 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.150890 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:00.151129 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.151101 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:22:00.151358 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.151332 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws" (OuterVolumeSpecName: "kube-api-access-nbpws") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "kube-api-access-nbpws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:22:00.151358 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.151347 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e30cc9d-b0c5-4bd2-8ad9-681522411acf" (UID: "5e30cc9d-b0c5-4bd2-8ad9-681522411acf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:22:00.249799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249764 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.249799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249791 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.249799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249801 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbpws\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-kube-api-access-nbpws\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.250046 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249810 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.250046 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249820 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.250046 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.249829 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e30cc9d-b0c5-4bd2-8ad9-681522411acf-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:00.470667 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.470568 2600 generic.go:356] "Generic (PLEG): container finished" podID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerID="b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25" exitCode=0 Jul 07 00:22:00.470667 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.470619 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" Jul 07 00:22:00.470907 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.470659 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerDied","Data":"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25"} Jul 07 00:22:00.470907 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.470719 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm" event={"ID":"5e30cc9d-b0c5-4bd2-8ad9-681522411acf","Type":"ContainerDied","Data":"6e11c8413c327036a6906fe148b2f60494afa00ff2ccc8c6a40c94b4f756e9ba"} Jul 07 00:22:00.470907 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.470749 2600 scope.go:117] "RemoveContainer" containerID="b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25" Jul 07 00:22:00.487804 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.487782 2600 scope.go:117] "RemoveContainer" containerID="6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23" Jul 07 00:22:00.498269 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.498227 2600 scope.go:117] "RemoveContainer" containerID="b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25" Jul 07 00:22:00.498505 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:22:00.498484 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25\": container with ID starting with b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25 not found: ID does not exist" containerID="b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25" Jul 07 00:22:00.498595 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.498521 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25"} err="failed to get container status \"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25\": rpc error: code = NotFound desc = could not find container \"b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25\": container with ID starting with b7e87fd02e052355853008f757a4a7b86429f27e24a7b2e97e1542716d851c25 not found: ID does not exist" Jul 07 00:22:00.498595 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.498546 2600 scope.go:117] "RemoveContainer" containerID="6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23" Jul 07 00:22:00.498934 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:22:00.498910 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23\": container with ID starting with 6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23 not found: ID does not exist" containerID="6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23" Jul 07 00:22:00.499005 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.498942 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23"} err="failed to get container status \"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23\": rpc error: code = NotFound desc = could not find container \"6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23\": container with ID starting with 6102f36ca9c45764c95b80bc8c0a3c7edb15d49a32f7042b915ac488e1056c23 not found: ID does not exist" Jul 07 00:22:00.500444 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.500423 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:22:00.503695 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:00.503672 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-aedad1-openshift-default-787694dd7-k5zhm"] Jul 07 00:22:01.823217 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:01.823173 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" path="/var/lib/kubelet/pods/5e30cc9d-b0c5-4bd2-8ad9-681522411acf/volumes" Jul 07 00:22:01.884879 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:01.884842 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:22:01.885154 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:01.885126 2600 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" containerID="cri-o://9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840" gracePeriod=30 Jul 07 00:22:07.141141 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.141103 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:22:07.211240 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211142 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211240 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211191 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211240 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211232 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htwzv\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211307 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211356 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211414 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:07.211522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211481 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211522 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211516 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211782 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211550 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211782 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211597 2600 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket\") pod \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\" (UID: \"f273dc73-a3c4-4ca7-ba56-c743b24269f4\") " Jul 07 00:22:07.211895 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211783 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:07.211954 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211929 2600 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-credential-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.211954 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211950 2600 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.212082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.211965 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:07.212144 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.212089 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 00:22:07.212330 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.212287 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:07.213733 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.213701 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:22:07.213733 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.213708 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 00:22:07.213891 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.213747 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv" (OuterVolumeSpecName: "kube-api-access-htwzv") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "kube-api-access-htwzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 00:22:07.213955 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.213917 2600 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f273dc73-a3c4-4ca7-ba56-c743b24269f4" (UID: "f273dc73-a3c4-4ca7-ba56-c743b24269f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 00:22:07.312843 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312810 2600 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.312843 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312835 2600 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istiod-ca-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.312843 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312845 2600 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-envoy\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.313104 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312860 2600 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-podinfo\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.313104 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312870 2600 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-workload-socket\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.313104 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312877 2600 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f273dc73-a3c4-4ca7-ba56-c743b24269f4-istio-data\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.313104 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.312886 2600 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htwzv\" (UniqueName: \"kubernetes.io/projected/f273dc73-a3c4-4ca7-ba56-c743b24269f4-kube-api-access-htwzv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\"" Jul 07 00:22:07.513590 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.513547 2600 generic.go:356] "Generic (PLEG): container finished" podID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerID="9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840" exitCode=0 Jul 07 00:22:07.513795 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.513602 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerDied","Data":"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840"} Jul 07 00:22:07.513795 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.513609 2600 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" Jul 07 00:22:07.513795 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.513652 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps" event={"ID":"f273dc73-a3c4-4ca7-ba56-c743b24269f4","Type":"ContainerDied","Data":"c2f3495a9bc7336a06cf5f7a6fb6613d0ceb5311ec64ed5e7c483318ca2469c4"} Jul 07 00:22:07.513795 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.513682 2600 scope.go:117] "RemoveContainer" containerID="9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840" Jul 07 00:22:07.524045 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.524026 2600 scope.go:117] "RemoveContainer" containerID="df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc" Jul 07 00:22:07.532506 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.532485 2600 scope.go:117] "RemoveContainer" containerID="9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840" Jul 07 00:22:07.532791 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:22:07.532769 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840\": container with ID starting with 9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840 not found: ID does not exist" containerID="9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840" Jul 07 00:22:07.532871 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.532798 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840"} err="failed to get container status \"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840\": rpc error: code = NotFound desc = could not find container \"9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840\": container with ID starting with 9d80f09b3744000e7c9e7b3330a5f78b7a6e7fe1d695c09e2c94d412ae697840 not found: ID does not exist" Jul 07 00:22:07.532871 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.532817 2600 scope.go:117] "RemoveContainer" containerID="df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc" Jul 07 00:22:07.533008 ip-10-0-132-64 kubenswrapper[2600]: E0707 00:22:07.532992 2600 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc\": container with ID starting with df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc not found: ID does not exist" containerID="df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc" Jul 07 00:22:07.533085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.533012 2600 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc"} err="failed to get container status \"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc\": rpc error: code = NotFound desc = could not find container \"df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc\": container with ID starting with df73b3afe28c33b0407622b3432b511df5cf4c7cb46dc8f891bd7785182179fc not found: ID does not exist" Jul 07 00:22:07.538321 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.538297 2600 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:22:07.541878 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.541855 2600 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-72fa7c-openshift-default-5c699d9dc-gtcps"] Jul 07 00:22:07.822280 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.822193 2600 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" path="/var/lib/kubelet/pods/f273dc73-a3c4-4ca7-ba56-c743b24269f4/volumes" Jul 07 00:22:07.886822 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:07.886791 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723040-dp6kr_15f73412-f213-4b71-bda2-13045416055c/cleanup/0.log" Jul 07 00:22:08.004252 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:08.004223 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-tn4f7_cb6d227e-f828-4e35-9921-3364c9a1fca8/cleanup/0.log" Jul 07 00:22:08.255268 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:08.255238 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xct6z_9613d86f-059f-4b71-a31a-3cc41a21b484/server/0.log" Jul 07 00:22:08.385036 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:08.385005 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w4f8b_9408ef64-f330-4cf1-b1f0-c952f724b7c1/manager/0.log" Jul 07 00:22:08.638318 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:08.638233 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-ckl8v_98477335-a950-44d1-9a07-924f1d7f6d50/copy-manifests/0.log" Jul 07 00:22:08.654990 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:08.654956 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-ckl8v_98477335-a950-44d1-9a07-924f1d7f6d50/manager/0.log" Jul 07 00:22:09.754902 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.754876 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/util/0.log" Jul 07 00:22:09.762187 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.762166 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/pull/0.log" Jul 07 00:22:09.769117 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.769096 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/extract/0.log" Jul 07 00:22:09.888015 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.887981 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/util/0.log" Jul 07 00:22:09.894907 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.894889 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/pull/0.log" Jul 07 00:22:09.903973 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:09.903954 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/extract/0.log" Jul 07 00:22:10.024403 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.024322 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/util/0.log" Jul 07 00:22:10.031823 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.031799 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/pull/0.log" Jul 07 00:22:10.039789 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.039763 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/extract/0.log" Jul 07 00:22:10.157071 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.157030 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/util/0.log" Jul 07 00:22:10.163931 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.163908 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/pull/0.log" Jul 07 00:22:10.173559 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.173540 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/extract/0.log" Jul 07 00:22:10.434231 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.434144 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gshxv_f889fdee-e850-4f1c-ad8d-58f9f30a00f8/manager/0.log" Jul 07 00:22:10.792837 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.792801 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wbpl5_28ca6d6f-99d8-4ab9-8318-ac7a69da7871/registry-server/0.log" Jul 07 00:22:10.916190 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:10.916144 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xvmzf_a4efd5e7-fdda-4be7-82ff-582149bef4b6/manager/0.log" Jul 07 00:22:11.051017 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:11.050943 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pw28l_af23bf84-a526-42f1-8744-8d83ec3059ff/limitador/0.log" Jul 07 00:22:11.560360 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:11.560332 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zdfs5_26526857-690d-4a5f-88a2-b07e750f2854/istio-proxy/0.log" Jul 07 00:22:11.685980 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:11.685951 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4hzc_461733e4-f410-417e-a73a-71d2413609d4/discovery/0.log" Jul 07 00:22:11.926623 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:11.926546 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5646546ff9-mfb4s_f258ffb1-d56b-4d6d-b305-d3dde20eb4e0/kube-auth-proxy/0.log" Jul 07 00:22:12.055205 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:12.055178 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/1.log" Jul 07 00:22:17.544820 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.544779 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rg28k/must-gather-5gwq6"] Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545156 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545173 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545187 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545196 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545219 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545258 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545226 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545295 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545304 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545312 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545318 2600 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e30cc9d-b0c5-4bd2-8ad9-681522411acf" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545378 2600 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.545481 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.545384 2600 state_mem.go:107] "Deleted CPUSet assignment" podUID="f273dc73-a3c4-4ca7-ba56-c743b24269f4" containerName="istio-proxy" Jul 07 00:22:17.548323 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.548308 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.551902 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.551872 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg28k\"/\"kube-root-ca.crt\"" Jul 07 00:22:17.552085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.551906 2600 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rg28k\"/\"default-dockercfg-dqkqt\"" Jul 07 00:22:17.552085 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.552025 2600 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg28k\"/\"openshift-service-ca.crt\"" Jul 07 00:22:17.569027 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.569000 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/must-gather-5gwq6"] Jul 07 00:22:17.704311 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.704270 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24nl\" (UniqueName: \"kubernetes.io/projected/fda83f99-0c60-441f-9d83-59120e995e93-kube-api-access-r24nl\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.704491 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.704353 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda83f99-0c60-441f-9d83-59120e995e93-must-gather-output\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.805081 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.804962 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda83f99-0c60-441f-9d83-59120e995e93-must-gather-output\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.805081 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.805029 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24nl\" (UniqueName: \"kubernetes.io/projected/fda83f99-0c60-441f-9d83-59120e995e93-kube-api-access-r24nl\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.805422 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.805400 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda83f99-0c60-441f-9d83-59120e995e93-must-gather-output\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.815850 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.815821 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24nl\" (UniqueName: \"kubernetes.io/projected/fda83f99-0c60-441f-9d83-59120e995e93-kube-api-access-r24nl\") pod \"must-gather-5gwq6\" (UID: \"fda83f99-0c60-441f-9d83-59120e995e93\") " pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.858219 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.858171 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/must-gather-5gwq6" Jul 07 00:22:17.997745 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:17.997718 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/must-gather-5gwq6"] Jul 07 00:22:17.999771 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:22:17.999741 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfda83f99_0c60_441f_9d83_59120e995e93.slice/crio-ec67ada33469227c31423d23cc78df9969298823ed7d01c0f8c398c5d2bd3969 WatchSource:0}: Error finding container ec67ada33469227c31423d23cc78df9969298823ed7d01c0f8c398c5d2bd3969: Status 404 returned error can't find the container with id ec67ada33469227c31423d23cc78df9969298823ed7d01c0f8c398c5d2bd3969 Jul 07 00:22:18.001654 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:18.001638 2600 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 00:22:18.574013 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:18.573978 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/must-gather-5gwq6" event={"ID":"fda83f99-0c60-441f-9d83-59120e995e93","Type":"ContainerStarted","Data":"ec67ada33469227c31423d23cc78df9969298823ed7d01c0f8c398c5d2bd3969"} Jul 07 00:22:19.584413 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:19.584020 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/must-gather-5gwq6" event={"ID":"fda83f99-0c60-441f-9d83-59120e995e93","Type":"ContainerStarted","Data":"9027e3f50c339de49286d38e9590e6eb14062a845f39effa10a683afa99a458b"} Jul 07 00:22:19.584413 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:19.584102 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/must-gather-5gwq6" event={"ID":"fda83f99-0c60-441f-9d83-59120e995e93","Type":"ContainerStarted","Data":"4baff6dea0928941d69d67030fb585cfb70200980d39f546426b16fd7bd33ef3"} Jul 07 00:22:19.605631 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:19.605551 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rg28k/must-gather-5gwq6" podStartSLOduration=1.763571867 podStartE2EDuration="2.605524537s" totalImagesPullingTime="841.95267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:19.601568256 +0000 UTC m=+2380.302329093" watchObservedRunningTime="2026-07-07 00:22:19.605524537 +0000 UTC m=+2380.306285361" Jul 07 00:22:20.476272 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:20.476243 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jh2wg_2b522481-71e4-4b14-9212-e483310aa5c2/global-pull-secret-syncer/0.log" Jul 07 00:22:20.649440 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:20.649397 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zsgf2_37c8c3b0-eb91-4ae7-97a0-a85eef1d7527/konnectivity-agent/0.log" Jul 07 00:22:20.671979 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:20.671950 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-64.ec2.internal_40a352da1f355ad260c3fbccfb0e7096/haproxy/0.log" Jul 07 00:22:25.363434 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.363396 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/extract/0.log" Jul 07 00:22:25.391313 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.391286 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/util/0.log" Jul 07 00:22:25.416030 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.415989 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ldcs7_f49a60e6-9bbb-4fe3-ab05-c7f6cf9b3f02/pull/0.log" Jul 07 00:22:25.453389 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.453359 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/extract/0.log" Jul 07 00:22:25.508121 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.508094 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/util/0.log" Jul 07 00:22:25.561364 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.561327 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05x5mb_1592ae0f-a5af-4d68-87d3-48a17389fddf/pull/0.log" Jul 07 00:22:25.608689 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.608659 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/extract/0.log" Jul 07 00:22:25.638875 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.638753 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/util/0.log" Jul 07 00:22:25.663783 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.663755 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl8gp_1f89d8a0-60b2-4a3f-8609-f3c1e9179738/pull/0.log" Jul 07 00:22:25.699658 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.699606 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/extract/0.log" Jul 07 00:22:25.728201 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.728155 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/util/0.log" Jul 07 00:22:25.753429 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:25.753382 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nd8nl_cad6441b-6ddd-4689-b55a-777544a3b6f0/pull/0.log" Jul 07 00:22:26.277218 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:26.277180 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gshxv_f889fdee-e850-4f1c-ad8d-58f9f30a00f8/manager/0.log" Jul 07 00:22:26.383934 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:26.383901 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wbpl5_28ca6d6f-99d8-4ab9-8318-ac7a69da7871/registry-server/0.log" Jul 07 00:22:26.527812 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:26.527728 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xvmzf_a4efd5e7-fdda-4be7-82ff-582149bef4b6/manager/0.log" Jul 07 00:22:26.549076 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:26.548300 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pw28l_af23bf84-a526-42f1-8744-8d83ec3059ff/limitador/0.log" Jul 07 00:22:28.484368 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.484335 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-hh97m_1e0f96fa-6365-470d-bbd3-e546f5abe6ef/kube-state-metrics/0.log" Jul 07 00:22:28.507799 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.507765 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-hh97m_1e0f96fa-6365-470d-bbd3-e546f5abe6ef/kube-rbac-proxy-main/0.log" Jul 07 00:22:28.532772 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.532737 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-hh97m_1e0f96fa-6365-470d-bbd3-e546f5abe6ef/kube-rbac-proxy-self/0.log" Jul 07 00:22:28.808910 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.808831 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnb8w_afd4ba76-0715-419f-a1af-cc2035aaeef9/node-exporter/0.log" Jul 07 00:22:28.834901 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.834871 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnb8w_afd4ba76-0715-419f-a1af-cc2035aaeef9/kube-rbac-proxy/0.log" Jul 07 00:22:28.858044 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:28.858010 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnb8w_afd4ba76-0715-419f-a1af-cc2035aaeef9/init-textfile/0.log" Jul 07 00:22:29.198720 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:29.198639 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-t484g_ad938dad-3709-4ccc-ae4b-e77a2597bb26/prometheus-operator/0.log" Jul 07 00:22:29.262410 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:29.262381 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-t484g_ad938dad-3709-4ccc-ae4b-e77a2597bb26/kube-rbac-proxy/0.log" Jul 07 00:22:29.340833 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:29.340776 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5774649c47-jf7dg_93c7eb94-8457-4ddb-9649-78594f65bcb1/telemeter-client/0.log" Jul 07 00:22:29.363359 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:29.363334 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5774649c47-jf7dg_93c7eb94-8457-4ddb-9649-78594f65bcb1/reload/0.log" Jul 07 00:22:29.384600 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:29.384541 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5774649c47-jf7dg_93c7eb94-8457-4ddb-9649-78594f65bcb1/kube-rbac-proxy/0.log" Jul 07 00:22:30.491444 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.491405 2600 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl"] Jul 07 00:22:30.496607 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.496580 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.504185 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.504155 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl"] Jul 07 00:22:30.547082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.546247 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-podres\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.547082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.546329 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-lib-modules\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.547082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.546454 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-sys\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.547082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.546493 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gc6k\" (UniqueName: \"kubernetes.io/projected/456c8196-629f-4e80-89fb-30fc73c48c34-kube-api-access-8gc6k\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.547082 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.546537 2600 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-proc\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.647823 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.647780 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-podres\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648092 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648000 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-podres\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648284 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648101 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-lib-modules\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648414 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648219 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-lib-modules\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648543 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648521 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-sys\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648653 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648383 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-sys\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.648824 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.648789 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gc6k\" (UniqueName: \"kubernetes.io/projected/456c8196-629f-4e80-89fb-30fc73c48c34-kube-api-access-8gc6k\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.649145 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.649119 2600 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-proc\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.649270 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.649249 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/456c8196-629f-4e80-89fb-30fc73c48c34-proc\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.662793 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.662763 2600 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gc6k\" (UniqueName: \"kubernetes.io/projected/456c8196-629f-4e80-89fb-30fc73c48c34-kube-api-access-8gc6k\") pod \"perf-node-gather-daemonset-ll9jl\" (UID: \"456c8196-629f-4e80-89fb-30fc73c48c34\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:30.814501 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:30.814396 2600 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:31.006715 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.006679 2600 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl"] Jul 07 00:22:31.008153 ip-10-0-132-64 kubenswrapper[2600]: W0707 00:22:31.008122 2600 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod456c8196_629f_4e80_89fb_30fc73c48c34.slice/crio-be743c23f2675b0d877200ca229a1fc1a5a42b05d87e6cfb24fb0451e38647a0 WatchSource:0}: Error finding container be743c23f2675b0d877200ca229a1fc1a5a42b05d87e6cfb24fb0451e38647a0: Status 404 returned error can't find the container with id be743c23f2675b0d877200ca229a1fc1a5a42b05d87e6cfb24fb0451e38647a0 Jul 07 00:22:31.678953 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.678295 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" event={"ID":"456c8196-629f-4e80-89fb-30fc73c48c34","Type":"ContainerStarted","Data":"58f211016123f58602aab74a322a9ef099800fe5c8acbbc9e9aef54159164625"} Jul 07 00:22:31.678953 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.678361 2600 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" event={"ID":"456c8196-629f-4e80-89fb-30fc73c48c34","Type":"ContainerStarted","Data":"be743c23f2675b0d877200ca229a1fc1a5a42b05d87e6cfb24fb0451e38647a0"} Jul 07 00:22:31.678953 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.678779 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:31.697424 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.697359 2600 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" podStartSLOduration=1.697336996 podStartE2EDuration="1.697336996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:31.693893508 +0000 UTC m=+2392.394654360" watchObservedRunningTime="2026-07-07 00:22:31.697336996 +0000 UTC m=+2392.398097817" Jul 07 00:22:31.779745 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.779688 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd5c8fd5-gh7wc_5c181138-23a9-482e-8a1b-ff14bfcf8c46/console/0.log" Jul 07 00:22:31.809262 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:31.809227 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-67v4v_62f2e392-4906-44e8-bffd-727f76e8a727/download-server/0.log" Jul 07 00:22:33.455899 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:33.455859 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4f4x_aa769a2b-b799-46ae-bd32-b34cd1d28fa9/dns/0.log" Jul 07 00:22:33.477037 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:33.476998 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4f4x_aa769a2b-b799-46ae-bd32-b34cd1d28fa9/kube-rbac-proxy/0.log" Jul 07 00:22:33.563790 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:33.563760 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4d9rt_781b53b6-ff3d-47e8-82a4-73694f2c26e5/dns-node-resolver/0.log" Jul 07 00:22:34.226600 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:34.226568 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29723040-rjgp5_c52aa2f8-b157-42a8-8456-f913de464126/image-pruner/0.log" Jul 07 00:22:34.274436 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:34.274400 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85db65fc77-qbt5g_6c5e54e1-d15d-4fbd-87fa-9cbff019e01d/registry/0.log" Jul 07 00:22:34.345401 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:34.345375 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wdpw4_466fd84d-3b4c-416b-9946-a2aa2c2e1a4f/node-ca/0.log" Jul 07 00:22:35.297479 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:35.297441 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zdfs5_26526857-690d-4a5f-88a2-b07e750f2854/istio-proxy/0.log" Jul 07 00:22:35.431757 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:35.431723 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4hzc_461733e4-f410-417e-a73a-71d2413609d4/discovery/0.log" Jul 07 00:22:35.482662 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:35.482635 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5646546ff9-mfb4s_f258ffb1-d56b-4d6d-b305-d3dde20eb4e0/kube-auth-proxy/0.log" Jul 07 00:22:35.512067 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:35.512007 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/0.log" Jul 07 00:22:35.555130 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:35.554999 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/1.log" Jul 07 00:22:36.338373 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:36.338325 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qfc6_b7875175-cdd9-4607-8656-1ad4415063b6/serve-healthcheck-canary/0.log" Jul 07 00:22:37.018188 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:37.018148 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shfxp_d32d430b-02c4-463e-9c35-0b3290677fc8/kube-rbac-proxy/0.log" Jul 07 00:22:37.038931 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:37.038880 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shfxp_d32d430b-02c4-463e-9c35-0b3290677fc8/exporter/0.log" Jul 07 00:22:37.061842 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:37.061810 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shfxp_d32d430b-02c4-463e-9c35-0b3290677fc8/extractor/0.log" Jul 07 00:22:37.702251 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:37.702216 2600 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-ll9jl" Jul 07 00:22:39.687644 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:39.687605 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723040-dp6kr_15f73412-f213-4b71-bda2-13045416055c/cleanup/0.log" Jul 07 00:22:39.716206 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:39.716180 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-tn4f7_cb6d227e-f828-4e35-9921-3364c9a1fca8/cleanup/0.log" Jul 07 00:22:39.842493 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:39.842422 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xct6z_9613d86f-059f-4b71-a31a-3cc41a21b484/server/0.log" Jul 07 00:22:39.928460 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:39.928368 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w4f8b_9408ef64-f330-4cf1-b1f0-c952f724b7c1/manager/0.log" Jul 07 00:22:40.077976 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:40.077912 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-ckl8v_98477335-a950-44d1-9a07-924f1d7f6d50/manager/0.log" Jul 07 00:22:40.096790 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:40.096757 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-ckl8v_98477335-a950-44d1-9a07-924f1d7f6d50/copy-manifests/0.log" Jul 07 00:22:41.555746 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:41.555714 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zdfs5_26526857-690d-4a5f-88a2-b07e750f2854/istio-proxy/0.log" Jul 07 00:22:41.684198 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:41.683857 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4hzc_461733e4-f410-417e-a73a-71d2413609d4/discovery/0.log" Jul 07 00:22:41.712942 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:41.712892 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5646546ff9-mfb4s_f258ffb1-d56b-4d6d-b305-d3dde20eb4e0/kube-auth-proxy/0.log" Jul 07 00:22:41.735441 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:41.735410 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/0.log" Jul 07 00:22:41.775535 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:41.775506 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/1.log" Jul 07 00:22:42.999184 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:42.999156 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zdfs5_26526857-690d-4a5f-88a2-b07e750f2854/istio-proxy/0.log" Jul 07 00:22:43.125729 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:43.125696 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q4hzc_461733e4-f410-417e-a73a-71d2413609d4/discovery/0.log" Jul 07 00:22:43.154241 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:43.154212 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5646546ff9-mfb4s_f258ffb1-d56b-4d6d-b305-d3dde20eb4e0/kube-auth-proxy/0.log" Jul 07 00:22:43.173931 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:43.173890 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/0.log" Jul 07 00:22:43.221984 ip-10-0-132-64 kubenswrapper[2600]: I0707 00:22:43.221948 2600 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gg5zf_eab01aa0-229a-48f4-8287-bc68df929bf4/istio-proxy/1.log"