Jul 22 01:45:40.621327 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 01:45:40.621339 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 01:45:40.621347 ip-10-0-132-26 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 01:45:40.621620 ip-10-0-132-26 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 01:45:51.961927 ip-10-0-132-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 22 01:45:51.961942 ip-10-0-132-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5a6e0007c46b4aeab9becea8a6aa4140 -- Jul 22 01:47:42.220239 ip-10-0-132-26 systemd[1]: Starting Kubernetes Kubelet... Jul 22 01:47:42.529930 ip-10-0-132-26 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:42.529930 ip-10-0-132-26 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 01:47:42.529930 ip-10-0-132-26 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:42.529930 ip-10-0-132-26 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 01:47:42.529930 ip-10-0-132-26 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:42.530852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.530758 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 01:47:42.535381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535358 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.535381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535382 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535387 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535390 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535395 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535399 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535403 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535406 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535409 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535411 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535414 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535417 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535419 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535422 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535424 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535427 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535430 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535433 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535435 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535437 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535444 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.535460 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535447 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535450 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535452 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535455 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535457 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535460 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535463 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535465 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535468 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535471 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535475 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535478 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535481 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535484 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535487 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535490 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535492 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535496 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.536002 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535501 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535503 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535505 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535508 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535510 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535513 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535515 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535518 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535521 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535523 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535526 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535528 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535530 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535534 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535538 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535542 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535545 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535548 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535551 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.536457 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535554 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535556 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535559 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535561 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535564 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535566 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535569 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535571 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535574 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535576 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535579 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535582 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535585 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535588 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535591 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535594 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535596 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535599 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535602 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535604 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.536945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535606 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535609 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535612 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535614 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535617 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535621 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535623 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535626 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535631 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535634 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535636 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535639 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535642 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535645 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535647 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535650 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535653 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535655 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535658 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.535660 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.537423 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536509 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536522 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536525 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536528 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536532 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536535 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536538 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536541 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536543 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536546 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536549 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536552 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536556 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536558 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536561 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536564 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536566 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536569 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536571 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536574 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.537923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536576 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536579 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536581 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536583 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536586 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536589 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536591 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536594 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536598 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536603 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536605 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536608 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536611 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536615 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536618 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536621 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536624 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536628 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536631 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.538442 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536634 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536637 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536639 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536642 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536644 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536646 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536649 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536652 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536654 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536657 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536659 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536661 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536664 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536667 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536670 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536673 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536676 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536678 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536681 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536684 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.538925 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536686 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536689 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536693 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536695 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536698 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536700 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536704 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536707 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536710 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536712 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536715 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536718 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536721 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536723 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536726 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536728 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536731 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536733 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536736 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536739 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.539417 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536741 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536744 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536746 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536749 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536751 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536754 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536756 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536759 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536761 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536763 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536766 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536769 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536771 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536774 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536778 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536781 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536784 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536787 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536790 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.539924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.536793 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537254 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537261 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537264 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537267 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537270 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537273 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537275 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537278 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537281 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537284 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537286 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537289 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537291 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537293 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537296 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537298 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537301 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537305 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.540381 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537310 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537313 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537316 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537319 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537323 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537325 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537327 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537330 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537333 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537335 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537337 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537340 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537342 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537344 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537348 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537350 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537353 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537355 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537358 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537360 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.540882 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537362 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537365 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537367 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537370 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537372 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537375 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537377 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537379 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537382 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537384 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537386 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537389 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537394 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537397 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537400 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537402 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537406 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537408 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537411 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537415 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.541371 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537418 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537421 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537424 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537427 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537432 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537435 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537437 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537447 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537450 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537452 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537455 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537458 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537460 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537462 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537465 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537467 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537470 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537473 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537475 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.541873 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537477 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537480 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537482 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537484 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537487 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537491 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537494 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537497 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537499 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537502 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537505 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537508 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537510 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537514 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537517 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537520 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537522 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537525 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537527 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537530 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.542350 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537532 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.537535 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537612 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537625 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537632 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537637 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537642 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537645 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537650 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537654 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537657 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537660 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537664 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537667 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537670 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537673 2564 flags.go:64] FLAG: --cgroup-root="" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537676 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537680 2564 flags.go:64] FLAG: --client-ca-file="" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537683 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537686 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537690 2564 flags.go:64] FLAG: --cluster-domain="" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537693 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537696 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537699 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 01:47:42.542825 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537702 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537706 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537709 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537712 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537715 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537719 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537722 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537725 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537728 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537731 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537736 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537739 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537742 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537745 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537748 2564 flags.go:64] FLAG: --enable-server="true" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537751 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537756 2564 flags.go:64] FLAG: --event-burst="100" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537759 2564 flags.go:64] FLAG: --event-qps="50" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537761 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537764 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537767 2564 flags.go:64] FLAG: --eviction-hard="" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537771 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537774 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537777 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537780 2564 flags.go:64] FLAG: --eviction-soft="" Jul 22 01:47:42.543430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537784 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537787 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537791 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537793 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537797 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537800 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537804 2564 flags.go:64] FLAG: --feature-gates="" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537808 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537811 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537815 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537818 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537821 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537824 2564 flags.go:64] FLAG: --help="false" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537826 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537830 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537833 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537836 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537839 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537844 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537847 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537850 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537853 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537856 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 01:47:42.544080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537858 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537876 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537879 2564 flags.go:64] FLAG: --kube-reserved="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537882 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537884 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537887 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537890 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537893 2564 flags.go:64] FLAG: --lock-file="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537895 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537900 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537903 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537909 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537912 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537916 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537919 2564 flags.go:64] FLAG: --logging-format="text" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537922 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537926 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537929 2564 flags.go:64] FLAG: --manifest-url="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537932 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537936 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537940 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537944 2564 flags.go:64] FLAG: --max-pods="110" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537947 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537950 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537953 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 01:47:42.544679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537956 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537959 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537962 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537966 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537973 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537976 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537979 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537982 2564 flags.go:64] FLAG: --pod-cidr="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537985 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537990 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537994 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.537997 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538000 2564 flags.go:64] FLAG: --port="10250" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538003 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538006 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d08f93235d52abc2" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538009 2564 flags.go:64] FLAG: --qos-reserved="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538013 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538017 2564 flags.go:64] FLAG: --register-node="true" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538020 2564 flags.go:64] FLAG: --register-with-taints="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538023 2564 flags.go:64] FLAG: --registry-burst="10" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538027 2564 flags.go:64] FLAG: --registry-qps="5" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538030 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538033 2564 flags.go:64] FLAG: --reserved-memory="" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538036 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538040 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 01:47:42.545309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538043 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538046 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538048 2564 flags.go:64] FLAG: --runonce="false" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538051 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538054 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538057 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538060 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538063 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538066 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538069 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538073 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538076 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538079 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538082 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538085 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538088 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538091 2564 flags.go:64] FLAG: --system-cgroups="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538094 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538099 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538102 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538104 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538108 2564 flags.go:64] FLAG: --tls-min-version="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538111 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538113 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538118 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 01:47:42.545947 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538121 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538124 2564 flags.go:64] FLAG: --v="2" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538130 2564 flags.go:64] FLAG: --version="false" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538134 2564 flags.go:64] FLAG: --vmodule="" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538138 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.538141 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538262 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538267 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538270 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538274 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538276 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538279 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538282 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538284 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538287 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538290 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538292 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538295 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538297 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538300 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538303 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.546563 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538305 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538308 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538311 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538314 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538316 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538319 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538321 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538323 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538326 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538328 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538332 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538335 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538337 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538341 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538343 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538346 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538348 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538352 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538356 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538359 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.547117 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538361 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538364 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538366 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538369 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538371 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538374 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538376 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538379 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538381 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538384 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538386 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538389 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538392 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538394 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538397 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538399 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538402 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538404 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538407 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538409 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.547636 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538412 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538415 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538419 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538421 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538424 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538428 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538431 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538434 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538436 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538439 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538443 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538445 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538448 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538450 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538453 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538455 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538458 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538461 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538463 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.548138 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538466 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538469 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538473 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538477 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538480 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538487 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538490 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538492 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538495 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538498 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538500 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538504 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538507 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538510 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538513 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538519 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538522 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538524 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538528 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.548609 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538530 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538533 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538535 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538538 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538540 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.538543 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.539167 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547128 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547149 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547169 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547175 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547236 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547242 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547245 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.549107 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547248 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547253 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547257 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547260 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547263 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547267 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547270 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547273 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547275 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547278 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547280 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547283 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547286 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547289 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547292 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547294 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547297 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547300 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547302 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547305 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.549458 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547307 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547309 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547312 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547314 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547317 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547319 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547323 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547326 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547329 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547331 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547334 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547337 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547339 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547342 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547345 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547347 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547350 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547353 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547355 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547358 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.550119 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547360 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547363 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547366 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547368 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547371 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547373 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547376 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547378 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547381 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547383 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547386 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547388 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547390 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547393 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547396 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547398 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547400 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547403 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547406 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.551028 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547409 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547411 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547414 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547416 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547419 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547421 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547425 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547428 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547431 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547433 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547435 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547438 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547442 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547445 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547448 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547451 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547453 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547456 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547458 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.551670 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547461 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547463 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547465 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547468 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547470 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547472 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547475 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547477 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547479 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547482 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547484 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547486 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547490 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547493 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547496 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547498 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547501 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.552192 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547503 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547509 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547623 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547627 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547630 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547635 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547638 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547641 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547644 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547647 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547650 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547653 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547656 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547658 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:42.552653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547660 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547663 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547665 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547667 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547670 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547672 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547674 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547677 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547679 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547681 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547684 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547686 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547688 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547691 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547694 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547696 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547699 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547701 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547704 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547706 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:42.553066 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547708 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547711 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547713 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547716 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547718 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547720 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547723 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547726 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547729 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547731 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547733 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547736 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547738 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547741 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547743 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547745 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547748 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547750 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547753 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547755 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:42.553704 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547757 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547760 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547763 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547765 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547768 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547770 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547773 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547776 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547778 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547781 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547783 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547785 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547788 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547790 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547793 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547795 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547798 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547800 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547803 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547805 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:42.554321 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547808 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547811 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547813 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547815 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547819 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547822 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547825 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547827 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547830 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547833 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547836 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547839 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547841 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547843 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547846 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547848 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547850 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547853 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547856 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:42.555036 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547876 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547881 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547886 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547891 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547894 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547896 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547899 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:42.547901 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.547907 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.548067 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.552228 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.553373 2564 server.go:1019] "Starting client certificate rotation" Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.553490 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:47:42.555786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.553604 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:47:42.556151 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.555508 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:47:42.558020 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.557998 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:47:42.565033 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.565007 2564 log.go:25] "Validated CRI v1 runtime API" Jul 22 01:47:42.567210 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.567194 2564 log.go:25] "Validated CRI v1 image API" Jul 22 01:47:42.568184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.568166 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 01:47:42.570364 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.570344 2564 fs.go:135] Filesystem UUIDs: map[5e78a570-a940-4152-b6dc-3e8efb233086:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a9d7bbc1-f861-4c23-9b07-a187dbe42ce3:/dev/nvme0n1p4] Jul 22 01:47:42.570438 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.570363 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 01:47:42.576144 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.576011 2564 manager.go:216] Machine: {Timestamp:2026-07-22 01:47:42.574180696 +0000 UTC m=+0.254836237 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094151 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b37c4e6b080d7a20394db5ec682a6 SystemUUID:ec2b37c4-e6b0-80d7-a203-94db5ec682a6 BootID:5a6e0007-c46b-4aea-b9be-cea8a6aa4140 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:f1:e6:db:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:f1:e6:db:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:ab:2a:97:e1:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 01:47:42.576144 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.576127 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 01:47:42.576295 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.576231 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 01:47:42.578856 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.578820 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 01:47:42.579026 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.578876 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 01:47:42.579945 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.579934 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 01:47:42.579981 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.579948 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 01:47:42.579981 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.579956 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:47:42.580574 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.580559 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:47:42.581726 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.581702 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 01:47:42.583715 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.583696 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:47:42.585482 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585469 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:47:42.585626 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585616 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 01:47:42.585666 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585657 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 22 01:47:42.585695 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585681 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 01:47:42.585723 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585708 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 01:47:42.585723 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585721 2564 kubelet.go:398] "Adding apiserver pod source" Jul 22 01:47:42.585785 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.585742 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 01:47:42.586454 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.586436 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:47:42.586454 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.586455 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:47:42.590211 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.590186 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 01:47:42.592189 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.592174 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 01:47:42.592249 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.592206 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 01:47:42.594235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594220 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 01:47:42.594280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594244 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 01:47:42.594280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594254 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 01:47:42.594280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594261 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 01:47:42.594280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594274 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594282 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594293 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594301 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594311 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594319 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594331 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 01:47:42.594385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594339 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 01:47:42.594941 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594927 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 01:47:42.594978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.594944 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 01:47:42.596932 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.596907 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 01:47:42.597024 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.596907 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 01:47:42.598674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.598661 2564 server.go:1268] "Started kubelet" Jul 22 01:47:42.598779 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.598746 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 01:47:42.598831 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.598770 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 01:47:42.598930 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.598882 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 01:47:42.599785 ip-10-0-132-26 systemd[1]: Started Kubernetes Kubelet. Jul 22 01:47:42.600884 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.600770 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 01:47:42.602395 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.601113 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 22 01:47:42.604970 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.604940 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 01:47:42.607990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.607966 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 01:47:42.607990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.607973 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 01:47:42.608459 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.608189 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:42.608573 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608537 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 01:47:42.608626 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608601 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 01:47:42.608626 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608617 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 01:47:42.608806 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608790 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 22 01:47:42.608806 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608802 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 22 01:47:42.609001 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.608985 2564 factory.go:55] Registering systemd factory Jul 22 01:47:42.609063 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609006 2564 factory.go:223] Registration of the systemd container factory successfully Jul 22 01:47:42.609342 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609323 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 01:47:42.609426 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609349 2564 factory.go:153] Registering CRI-O factory Jul 22 01:47:42.609426 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609367 2564 factory.go:223] Registration of the crio container factory successfully Jul 22 01:47:42.609511 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609494 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 01:47:42.609560 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609510 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mc4gm" Jul 22 01:47:42.609560 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609525 2564 factory.go:103] Registering Raw factory Jul 22 01:47:42.609560 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.609543 2564 manager.go:1196] Started watching for new ooms in manager Jul 22 01:47:42.610143 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.610126 2564 manager.go:349] Starting recovery of all containers Jul 22 01:47:42.610492 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.609405 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-26.ec2.internal.18c4796d47353a74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-26.ec2.internal,UID:ip-10-0-132-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-26.ec2.internal,},FirstTimestamp:2026-07-22 01:47:42.598625908 +0000 UTC m=+0.279281449,LastTimestamp:2026-07-22 01:47:42.598625908 +0000 UTC m=+0.279281449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-26.ec2.internal,}" Jul 22 01:47:42.613206 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.613179 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 01:47:42.613402 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.613222 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 01:47:42.617760 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.617722 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mc4gm" Jul 22 01:47:42.623460 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.623436 2564 manager.go:354] Recovery completed Jul 22 01:47:42.628086 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.628068 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.630380 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630358 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.630497 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630394 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.630497 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630405 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.630935 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630919 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.631018 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630920 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 01:47:42.631018 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630964 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 01:47:42.631018 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.630985 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:47:42.632121 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.632102 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.632183 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.632137 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.632183 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.632148 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.632536 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.632432 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-26.ec2.internal.18c4796d4919bf2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-26.ec2.internal,UID:ip-10-0-132-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-26.ec2.internal,},FirstTimestamp:2026-07-22 01:47:42.630379308 +0000 UTC m=+0.311034851,LastTimestamp:2026-07-22 01:47:42.630379308 +0000 UTC m=+0.311034851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-26.ec2.internal,}" Jul 22 01:47:42.633201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.633169 2564 policy_none.go:49] "None policy: Start" Jul 22 01:47:42.633201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.633189 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 01:47:42.633201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.633201 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 01:47:42.635318 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.635302 2564 policy_none.go:47] "Start" Jul 22 01:47:42.671071 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.670821 2564 manager.go:337] "Starting Device Plugin manager" Jul 22 01:47:42.671182 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.671111 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 01:47:42.671182 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671123 2564 server.go:87] "Starting device plugin registration server" Jul 22 01:47:42.671370 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671359 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 01:47:42.671410 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671371 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 01:47:42.671504 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671485 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 01:47:42.671595 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671581 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 01:47:42.671642 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.671595 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 01:47:42.672326 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.672306 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 01:47:42.672438 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.672351 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:42.746928 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.746883 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 01:47:42.749167 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.748287 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 01:47:42.749167 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.748331 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 01:47:42.749167 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.748355 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 01:47:42.749167 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.748393 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 01:47:42.751153 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.751123 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:42.772447 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.772411 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.773651 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.773633 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.773752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.773675 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.773752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.773685 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.773752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.773717 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.782338 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.782258 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.782338 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.782292 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-26.ec2.internal\": node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:42.796667 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.796636 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:42.848698 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.848638 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal"] Jul 22 01:47:42.848911 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.848761 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.849921 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.849903 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.849989 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.849940 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.849989 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.849951 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.852539 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.852524 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.852635 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.852621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.852687 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.852662 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.853548 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853527 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.853665 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853562 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.853665 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853571 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.853665 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853569 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.853758 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853684 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.853758 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.853695 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.856153 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.856133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.856277 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.856171 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:42.857083 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.857068 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:42.857165 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.857096 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:42.857165 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.857111 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:42.885960 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.885928 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-26.ec2.internal\" not found" node="ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.890741 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.890708 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-26.ec2.internal\" not found" node="ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.896737 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.896711 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:42.910794 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.910760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f64161d52888b147e761296e566a51e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"6f64161d52888b147e761296e566a51e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.910794 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.910793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.910960 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:42.910839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:42.997528 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:42.997486 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.011200 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.011266 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.011266 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f64161d52888b147e761296e566a51e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"6f64161d52888b147e761296e566a51e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.011327 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.011327 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7609d42ab4a2029c30229f73c41e2b48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal\" (UID: \"7609d42ab4a2029c30229f73c41e2b48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.011386 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.011288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f64161d52888b147e761296e566a51e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-26.ec2.internal\" (UID: \"6f64161d52888b147e761296e566a51e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.098700 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.098575 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.189195 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.189139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.193109 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.193074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.199360 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.199339 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.299466 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.299424 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.400638 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.400560 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.500840 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.500806 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.553043 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.553004 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 01:47:43.553537 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.553215 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:47:43.601857 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.601822 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.623610 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.623564 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 01:42:43 +0000 UTC" deadline="2028-03-04 21:07:40.832745911 +0000 UTC" Jul 22 01:47:43.623610 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.623604 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14203h19m57.209145973s" Jul 22 01:47:43.702298 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.702187 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.757516 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:43.757397 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7609d42ab4a2029c30229f73c41e2b48.slice/crio-93d1fc08cb8afcd6afaf71ecfe780f55af69168653a3924843e41cee225ddbeb WatchSource:0}: Error finding container 93d1fc08cb8afcd6afaf71ecfe780f55af69168653a3924843e41cee225ddbeb: Status 404 returned error can't find the container with id 93d1fc08cb8afcd6afaf71ecfe780f55af69168653a3924843e41cee225ddbeb Jul 22 01:47:43.763104 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.763077 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:47:43.771588 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:43.771551 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f64161d52888b147e761296e566a51e.slice/crio-d8cbaffee88b7e70842e45783b66b4dfce74056810c0d738e8a7e6e2380cca9d WatchSource:0}: Error finding container d8cbaffee88b7e70842e45783b66b4dfce74056810c0d738e8a7e6e2380cca9d: Status 404 returned error can't find the container with id d8cbaffee88b7e70842e45783b66b4dfce74056810c0d738e8a7e6e2380cca9d Jul 22 01:47:43.802417 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:43.802364 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-26.ec2.internal\" not found" Jul 22 01:47:43.864377 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.864346 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:43.908712 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.908676 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.927973 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.927929 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:47:43.929464 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.929447 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" Jul 22 01:47:43.947787 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:43.947756 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:47:44.027368 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.027272 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:44.123047 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.123012 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:44.578992 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.578763 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:44.587290 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.587024 2564 apiserver.go:52] "Watching apiserver" Jul 22 01:47:44.593571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.593353 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 01:47:44.595252 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.595220 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-cmgp6","openshift-image-registry/node-ca-d56zk","openshift-multus/multus-additional-cni-plugins-jsc72","openshift-multus/network-metrics-daemon-wthqb","openshift-ovn-kubernetes/ovnkube-node-rgqbp","kube-system/global-pull-secret-syncer-g89k2","kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l","openshift-cluster-node-tuning-operator/tuned-wj8j5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal","openshift-multus/multus-dmmrv","openshift-network-diagnostics/network-check-target-nx9v7","openshift-network-operator/iptables-alerter-l2jdt","kube-system/konnectivity-agent-x6zpb"] Jul 22 01:47:44.599177 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.598227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.602155 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.601495 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sfnlg\"" Jul 22 01:47:44.602155 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.601889 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.602155 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.602125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.602390 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.602163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.602775 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.602752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 01:47:44.604246 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.604226 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 01:47:44.604529 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.604512 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.604762 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.604747 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gg4rm\"" Jul 22 01:47:44.604987 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.604972 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.607320 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.607299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.609320 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.609295 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 01:47:44.609911 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.609888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.610280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.610280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610213 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7kvf\"" Jul 22 01:47:44.610280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 01:47:44.610387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.610423 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.610371 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:44.610457 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610420 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 01:47:44.610518 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.610497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 01:47:44.614007 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.613983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.616915 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.616885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.617047 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.617001 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:44.617201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.617179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 01:47:44.617434 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.617413 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 01:47:44.617710 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.617690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 01:47:44.617849 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.617831 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pm2n6\"" Jul 22 01:47:44.618413 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.618390 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.618512 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.618474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 01:47:44.618799 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.618782 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.619385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.619366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-host\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4rkp\" (UniqueName: \"kubernetes.io/projected/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-kube-api-access-z4rkp\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-system-cni-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-os-release\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dv2p\" (UniqueName: \"kubernetes.io/projected/b9cadc2e-8357-47e3-a826-24655eff089f-kube-api-access-5dv2p\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-serviceca\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m56zs\" (UniqueName: \"kubernetes.io/projected/f622e6fa-da66-4557-9fc0-0d441cde2ea8-kube-api-access-m56zs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9cadc2e-8357-47e3-a826-24655eff089f-iptables-alerter-script\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cadc2e-8357-47e3-a826-24655eff089f-host-slash\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cnibin\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.622374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clf5x\" (UniqueName: \"kubernetes.io/projected/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-kube-api-access-clf5x\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.623459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.621880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.623459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.622029 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wnsk7\"" Jul 22 01:47:44.623459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.622277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.623459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.623400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.623651 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.623499 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:47:44.626908 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.626068 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.626908 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.626393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 01:47:44.626908 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.626590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.626908 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.626858 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pgbfd\"" Jul 22 01:47:44.627231 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.627103 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.629123 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.629095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.629401 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.629378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:47:44.629835 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.629814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zqlx4\"" Jul 22 01:47:44.630246 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.630221 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 01:47:44.633272 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.633248 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 01:47:44.633433 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.633416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2f8g8\"" Jul 22 01:47:44.633535 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.633521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 01:47:44.634374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.634351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.637759 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.637337 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rt8gk\"" Jul 22 01:47:44.637759 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.637581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 01:47:44.638596 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.638274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:44.638596 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.638393 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:44.647556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.647519 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-msj4j" Jul 22 01:47:44.657836 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.657753 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-msj4j" Jul 22 01:47:44.709891 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.709852 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.721988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvl2n\" (UniqueName: \"kubernetes.io/projected/21093df0-5e58-470e-9d25-a256f6d3c6fe-kube-api-access-tvl2n\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cnibin\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clf5x\" (UniqueName: \"kubernetes.io/projected/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-kube-api-access-clf5x\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3d1d24-3406-41f9-a078-53d752d856c8-tmp-dir\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-sys-fs\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-host\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-script-lib\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2snx\" (UniqueName: \"kubernetes.io/projected/4a53eca3-2480-48f7-86bf-f1ea098d7265-kube-api-access-c2snx\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovn-node-metrics-cert\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cnibin\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-dbus\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-host\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-var-lib-kubelet\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.722317 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-conf-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-daemon-config\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-multus-certs\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-etc-kubernetes\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m56zs\" (UniqueName: \"kubernetes.io/projected/f622e6fa-da66-4557-9fc0-0d441cde2ea8-kube-api-access-m56zs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-ovn\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9cadc2e-8357-47e3-a826-24655eff089f-iptables-alerter-script\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cadc2e-8357-47e3-a826-24655eff089f-host-slash\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-systemd-units\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-env-overrides\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722719 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9cadc2e-8357-47e3-a826-24655eff089f-host-slash\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722746 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-bin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-multus\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.723201 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4rkp\" (UniqueName: \"kubernetes.io/projected/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-kube-api-access-z4rkp\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-systemd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-log-socket\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-node-log\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s24rs\" (UniqueName: \"kubernetes.io/projected/bbd5a50b-7945-4046-9563-fde8e90e0faf-kube-api-access-s24rs\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.722988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-registration-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-conf\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-tuned\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-k8s-cni-cncf-io\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-etc-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysconfig\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-tmp\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-cni-binary-copy\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.724019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-var-lib-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-slash\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-device-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723363 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9cadc2e-8357-47e3-a826-24655eff089f-iptables-alerter-script\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-kubernetes\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-socket-dir-parent\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-system-cni-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-os-release\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3d1d24-3406-41f9-a078-53d752d856c8-hosts-file\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-modprobe-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-system-cni-dir\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-os-release\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-lib-modules\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/645102e9-2138-44ba-9fc0-1a739c7d8293-konnectivity-ca\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-system-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-netns\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.724571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-serviceca\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-netns\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n64w\" (UniqueName: \"kubernetes.io/projected/3f3d1d24-3406-41f9-a078-53d752d856c8-kube-api-access-7n64w\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-systemd\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-sys\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/645102e9-2138-44ba-9fc0-1a739c7d8293-agent-certs\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.723956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-kubelet\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724030 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-bin\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-kubelet-config\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-socket-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd92l\" (UniqueName: \"kubernetes.io/projected/5bc949b4-2895-4665-97ac-38014c3bdb96-kube-api-access-qd92l\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-cnibin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-hostroot\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-serviceca\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.725279 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-host\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724305 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dv2p\" (UniqueName: \"kubernetes.io/projected/b9cadc2e-8357-47e3-a826-24655eff089f-kube-api-access-5dv2p\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-netd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-config\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.724452 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-run\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-os-release\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.724535 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:45.224497493 +0000 UTC m=+2.905153038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-kubelet\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.725893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.724753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.734309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.734267 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 01:47:44.739194 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.739145 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dv2p\" (UniqueName: \"kubernetes.io/projected/b9cadc2e-8357-47e3-a826-24655eff089f-kube-api-access-5dv2p\") pod \"iptables-alerter-l2jdt\" (UID: \"b9cadc2e-8357-47e3-a826-24655eff089f\") " pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.739194 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.739169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4rkp\" (UniqueName: \"kubernetes.io/projected/17d355d5-f3da-4c24-8c70-c1d3b1e9a675-kube-api-access-z4rkp\") pod \"node-ca-d56zk\" (UID: \"17d355d5-f3da-4c24-8c70-c1d3b1e9a675\") " pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.739466 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.739157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m56zs\" (UniqueName: \"kubernetes.io/projected/f622e6fa-da66-4557-9fc0-0d441cde2ea8-kube-api-access-m56zs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:44.742417 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.742384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clf5x\" (UniqueName: \"kubernetes.io/projected/1d5426e0-f5ca-4c8b-a243-942cc835dc9a-kube-api-access-clf5x\") pod \"multus-additional-cni-plugins-jsc72\" (UID: \"1d5426e0-f5ca-4c8b-a243-942cc835dc9a\") " pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.754247 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.754175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" event={"ID":"6f64161d52888b147e761296e566a51e","Type":"ContainerStarted","Data":"d8cbaffee88b7e70842e45783b66b4dfce74056810c0d738e8a7e6e2380cca9d"} Jul 22 01:47:44.755520 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.755477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"7609d42ab4a2029c30229f73c41e2b48","Type":"ContainerStarted","Data":"93d1fc08cb8afcd6afaf71ecfe780f55af69168653a3924843e41cee225ddbeb"} Jul 22 01:47:44.825802 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-script-lib\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.825802 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2snx\" (UniqueName: \"kubernetes.io/projected/4a53eca3-2480-48f7-86bf-f1ea098d7265-kube-api-access-c2snx\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovn-node-metrics-cert\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-dbus\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-var-lib-kubelet\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-conf-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-daemon-config\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.825998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-multus-certs\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-etc-kubernetes\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-ovn\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-systemd-units\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-env-overrides\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-bin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-multus\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-systemd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-log-socket\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-node-log\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s24rs\" (UniqueName: \"kubernetes.io/projected/bbd5a50b-7945-4046-9563-fde8e90e0faf-kube-api-access-s24rs\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-registration-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-conf\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-tuned\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-k8s-cni-cncf-io\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-etc-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.826519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysconfig\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-script-lib\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-multus-certs\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-etc-kubernetes\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826760 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-daemon-config\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-ovn\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-systemd-units\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-var-lib-kubelet\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.826593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-tmp\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-cni-binary-copy\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-var-lib-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-slash\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-device-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-dbus\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.827356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-kubernetes\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-socket-dir-parent\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-var-lib-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3d1d24-3406-41f9-a078-53d752d856c8-hosts-file\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-slash\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-env-overrides\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827354 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3d1d24-3406-41f9-a078-53d752d856c8-hosts-file\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-modprobe-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-lib-modules\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-kubernetes\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-device-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/645102e9-2138-44ba-9fc0-1a739c7d8293-konnectivity-ca\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-modprobe-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827354 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-socket-dir-parent\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-system-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-bin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827562 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-conf\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.828485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-log-socket\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827607 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-node-log\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-netns\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-run-systemd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-registration-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-lib-modules\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-netns\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-cni-multus\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21093df0-5e58-470e-9d25-a256f6d3c6fe-cni-binary-copy\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.827445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-multus-conf-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-netns\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n64w\" (UniqueName: \"kubernetes.io/projected/3f3d1d24-3406-41f9-a078-53d752d856c8-kube-api-access-7n64w\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-etc-openvswitch\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828089 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-systemd\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828134 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-system-cni-dir\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-sys\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysconfig\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.829453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/645102e9-2138-44ba-9fc0-1a739c7d8293-agent-certs\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-run-k8s-cni-cncf-io\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-systemd\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-kubelet\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-sys\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-bin\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828277 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/645102e9-2138-44ba-9fc0-1a739c7d8293-konnectivity-ca\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-kubelet-config\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-run-netns\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-socket-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828328 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-bin\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd92l\" (UniqueName: \"kubernetes.io/projected/5bc949b4-2895-4665-97ac-38014c3bdb96-kube-api-access-qd92l\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-cnibin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-kubelet\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e34f5790-2bd6-4705-8140-768ecb509768-kubelet-config\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-cnibin\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-hostroot\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-hostroot\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830425 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-socket-dir\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-host\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-netd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-host\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-config\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbd5a50b-7945-4046-9563-fde8e90e0faf-host-cni-netd\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-sysctl-d\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-run\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.828936 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-os-release\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-kubelet\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvl2n\" (UniqueName: \"kubernetes.io/projected/21093df0-5e58-470e-9d25-a256f6d3c6fe-kube-api-access-tvl2n\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.829071 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:45.329051119 +0000 UTC m=+3.009706649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3d1d24-3406-41f9-a078-53d752d856c8-tmp-dir\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.830978 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-sys-fs\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovnkube-config\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.828996 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc949b4-2895-4665-97ac-38014c3bdb96-run\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-os-release\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21093df0-5e58-470e-9d25-a256f6d3c6fe-host-var-lib-kubelet\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-sys-fs\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829650 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a53eca3-2480-48f7-86bf-f1ea098d7265-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3d1d24-3406-41f9-a078-53d752d856c8-tmp-dir\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.829811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbd5a50b-7945-4046-9563-fde8e90e0faf-ovn-node-metrics-cert\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.831067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-tmp\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.831740 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.831736 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/645102e9-2138-44ba-9fc0-1a739c7d8293-agent-certs\") pod \"konnectivity-agent-x6zpb\" (UID: \"645102e9-2138-44ba-9fc0-1a739c7d8293\") " pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.832805 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.832771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc949b4-2895-4665-97ac-38014c3bdb96-etc-tuned\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.840195 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.840166 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:44.840349 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.840202 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:44.840349 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.840217 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:44.840349 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:44.840286 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:45.34026475 +0000 UTC m=+3.020920284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:44.843137 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.843105 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2snx\" (UniqueName: \"kubernetes.io/projected/4a53eca3-2480-48f7-86bf-f1ea098d7265-kube-api-access-c2snx\") pod \"aws-ebs-csi-driver-node-kwn8l\" (UID: \"4a53eca3-2480-48f7-86bf-f1ea098d7265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.843607 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.843589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s24rs\" (UniqueName: \"kubernetes.io/projected/bbd5a50b-7945-4046-9563-fde8e90e0faf-kube-api-access-s24rs\") pod \"ovnkube-node-rgqbp\" (UID: \"bbd5a50b-7945-4046-9563-fde8e90e0faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.843800 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.843777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd92l\" (UniqueName: \"kubernetes.io/projected/5bc949b4-2895-4665-97ac-38014c3bdb96-kube-api-access-qd92l\") pod \"tuned-wj8j5\" (UID: \"5bc949b4-2895-4665-97ac-38014c3bdb96\") " pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.844257 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.844207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n64w\" (UniqueName: \"kubernetes.io/projected/3f3d1d24-3406-41f9-a078-53d752d856c8-kube-api-access-7n64w\") pod \"node-resolver-cmgp6\" (UID: \"3f3d1d24-3406-41f9-a078-53d752d856c8\") " pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.844644 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.844622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvl2n\" (UniqueName: \"kubernetes.io/projected/21093df0-5e58-470e-9d25-a256f6d3c6fe-kube-api-access-tvl2n\") pod \"multus-dmmrv\" (UID: \"21093df0-5e58-470e-9d25-a256f6d3c6fe\") " pod="openshift-multus/multus-dmmrv" Jul 22 01:47:44.916057 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.916019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l2jdt" Jul 22 01:47:44.928980 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.928923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d56zk" Jul 22 01:47:44.941136 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.941095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jsc72" Jul 22 01:47:44.948653 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.948615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:47:44.959011 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.958974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmgp6" Jul 22 01:47:44.970561 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.970328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" Jul 22 01:47:44.980657 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.980625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" Jul 22 01:47:44.990030 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.989990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:47:44.996443 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:44.996402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dmmrv" Jul 22 01:47:45.233232 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:45.233137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:45.233417 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.233334 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:45.233417 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.233413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:46.233391254 +0000 UTC m=+3.914046791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:45.333793 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:45.333755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:45.334027 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.333915 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:45.334027 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.333987 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:46.333967443 +0000 UTC m=+4.014622976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:45.434161 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:45.434126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:45.434364 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.434265 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:45.434364 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.434282 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:45.434364 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.434293 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:45.434364 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:45.434353 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:46.43433842 +0000 UTC m=+4.114993951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:45.662056 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:45.662003 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:42:45 +0000 UTC" deadline="2028-01-22 18:30:14.163292276 +0000 UTC" Jul 22 01:47:45.662056 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:45.662043 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13192h42m28.5012524s" Jul 22 01:47:45.782373 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.782340 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd5a50b_7945_4046_9563_fde8e90e0faf.slice/crio-28d4b05c20541f708e3a66a9dbabbbdc21f94e9182139d4b9811e813122838f8 WatchSource:0}: Error finding container 28d4b05c20541f708e3a66a9dbabbbdc21f94e9182139d4b9811e813122838f8: Status 404 returned error can't find the container with id 28d4b05c20541f708e3a66a9dbabbbdc21f94e9182139d4b9811e813122838f8 Jul 22 01:47:45.783945 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.783891 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d355d5_f3da_4c24_8c70_c1d3b1e9a675.slice/crio-fe37f8381e798fb6b23c82fb6b6c9872f7548b53c6630797f90e5b9345d79edb WatchSource:0}: Error finding container fe37f8381e798fb6b23c82fb6b6c9872f7548b53c6630797f90e5b9345d79edb: Status 404 returned error can't find the container with id fe37f8381e798fb6b23c82fb6b6c9872f7548b53c6630797f90e5b9345d79edb Jul 22 01:47:45.788653 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.788624 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3d1d24_3406_41f9_a078_53d752d856c8.slice/crio-fe645f27cd30cb5b5d119c7b38f1bb2dcf8d342f95d693803164a069edfa68e3 WatchSource:0}: Error finding container fe645f27cd30cb5b5d119c7b38f1bb2dcf8d342f95d693803164a069edfa68e3: Status 404 returned error can't find the container with id fe645f27cd30cb5b5d119c7b38f1bb2dcf8d342f95d693803164a069edfa68e3 Jul 22 01:47:45.791418 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.791382 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc949b4_2895_4665_97ac_38014c3bdb96.slice/crio-d4f353c385aff0bb4430b4853f3205e191280598540687bf609794c77d6f7065 WatchSource:0}: Error finding container d4f353c385aff0bb4430b4853f3205e191280598540687bf609794c77d6f7065: Status 404 returned error can't find the container with id d4f353c385aff0bb4430b4853f3205e191280598540687bf609794c77d6f7065 Jul 22 01:47:45.814494 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.814455 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645102e9_2138_44ba_9fc0_1a739c7d8293.slice/crio-5405aa41f4a586d84faf6b9738128f456329bfcda9671d24443be6253d340fff WatchSource:0}: Error finding container 5405aa41f4a586d84faf6b9738128f456329bfcda9671d24443be6253d340fff: Status 404 returned error can't find the container with id 5405aa41f4a586d84faf6b9738128f456329bfcda9671d24443be6253d340fff Jul 22 01:47:45.815552 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.815520 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21093df0_5e58_470e_9d25_a256f6d3c6fe.slice/crio-397b89bcf7cabeb01eaa3cf5deb7676ce5329223301ed912f36daf2e0a94108f WatchSource:0}: Error finding container 397b89bcf7cabeb01eaa3cf5deb7676ce5329223301ed912f36daf2e0a94108f: Status 404 returned error can't find the container with id 397b89bcf7cabeb01eaa3cf5deb7676ce5329223301ed912f36daf2e0a94108f Jul 22 01:47:45.816204 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.816179 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5426e0_f5ca_4c8b_a243_942cc835dc9a.slice/crio-96101262667cc553b02286b205907deeb971b6c9ac39d54a602aeac93d88bb7c WatchSource:0}: Error finding container 96101262667cc553b02286b205907deeb971b6c9ac39d54a602aeac93d88bb7c: Status 404 returned error can't find the container with id 96101262667cc553b02286b205907deeb971b6c9ac39d54a602aeac93d88bb7c Jul 22 01:47:45.822323 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:47:45.820538 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a53eca3_2480_48f7_86bf_f1ea098d7265.slice/crio-50839e8a52a5d0fc60a58babe0be5728823753611946de50032d112689336db6 WatchSource:0}: Error finding container 50839e8a52a5d0fc60a58babe0be5728823753611946de50032d112689336db6: Status 404 returned error can't find the container with id 50839e8a52a5d0fc60a58babe0be5728823753611946de50032d112689336db6 Jul 22 01:47:46.242854 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.241922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:46.242854 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.242187 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:46.242854 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.242355 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:48.242325698 +0000 UTC m=+5.922981228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:46.343986 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.343269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:46.343986 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.343493 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:46.343986 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.343559 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:48.343539634 +0000 UTC m=+6.024195166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:46.444764 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.444069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:46.444764 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.444260 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:46.444764 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.444281 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:46.444764 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.444296 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:46.444764 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.444360 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:48.444340818 +0000 UTC m=+6.124996356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:46.663014 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.662846 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:42:45 +0000 UTC" deadline="2028-02-15 19:39:50.850582996 +0000 UTC" Jul 22 01:47:46.663014 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.662939 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13769h52m4.187648565s" Jul 22 01:47:46.750161 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.750057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:46.750161 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.750084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:46.750457 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.750204 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:46.751000 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.750676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:46.751000 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.750760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:46.751000 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:46.750898 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:46.775758 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.775715 2564 generic.go:356] "Generic (PLEG): container finished" podID="7609d42ab4a2029c30229f73c41e2b48" containerID="efc425f85b8e74afdd435b06afef6d1911f09f3019eff2af10c2d5f20eb604a1" exitCode=0 Jul 22 01:47:46.776459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.776428 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"7609d42ab4a2029c30229f73c41e2b48","Type":"ContainerDied","Data":"efc425f85b8e74afdd435b06afef6d1911f09f3019eff2af10c2d5f20eb604a1"} Jul 22 01:47:46.790799 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.790734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dmmrv" event={"ID":"21093df0-5e58-470e-9d25-a256f6d3c6fe","Type":"ContainerStarted","Data":"397b89bcf7cabeb01eaa3cf5deb7676ce5329223301ed912f36daf2e0a94108f"} Jul 22 01:47:46.804178 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.804022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2jdt" event={"ID":"b9cadc2e-8357-47e3-a826-24655eff089f","Type":"ContainerStarted","Data":"d009850b8bec733e5a0df32a77e3ac1a2dccffbd81a386aa2c95eebf91a83595"} Jul 22 01:47:46.813247 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.813054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6zpb" event={"ID":"645102e9-2138-44ba-9fc0-1a739c7d8293","Type":"ContainerStarted","Data":"5405aa41f4a586d84faf6b9738128f456329bfcda9671d24443be6253d340fff"} Jul 22 01:47:46.832969 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.829299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" event={"ID":"5bc949b4-2895-4665-97ac-38014c3bdb96","Type":"ContainerStarted","Data":"d4f353c385aff0bb4430b4853f3205e191280598540687bf609794c77d6f7065"} Jul 22 01:47:46.837292 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.837220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmgp6" event={"ID":"3f3d1d24-3406-41f9-a078-53d752d856c8","Type":"ContainerStarted","Data":"fe645f27cd30cb5b5d119c7b38f1bb2dcf8d342f95d693803164a069edfa68e3"} Jul 22 01:47:46.847401 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.847291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d56zk" event={"ID":"17d355d5-f3da-4c24-8c70-c1d3b1e9a675","Type":"ContainerStarted","Data":"fe37f8381e798fb6b23c82fb6b6c9872f7548b53c6630797f90e5b9345d79edb"} Jul 22 01:47:46.877645 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.876769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" event={"ID":"6f64161d52888b147e761296e566a51e","Type":"ContainerStarted","Data":"34468632c37ba28790a60979437336e5e36abb84c98cad0371f0f731db4adafe"} Jul 22 01:47:46.897150 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.897038 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-26.ec2.internal" podStartSLOduration=2.897005957 podStartE2EDuration="2.897005957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:46.8958545 +0000 UTC m=+4.576510061" watchObservedRunningTime="2026-07-22 01:47:46.897005957 +0000 UTC m=+4.577661514" Jul 22 01:47:46.916177 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.916059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerStarted","Data":"96101262667cc553b02286b205907deeb971b6c9ac39d54a602aeac93d88bb7c"} Jul 22 01:47:46.923079 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.923034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" event={"ID":"4a53eca3-2480-48f7-86bf-f1ea098d7265","Type":"ContainerStarted","Data":"50839e8a52a5d0fc60a58babe0be5728823753611946de50032d112689336db6"} Jul 22 01:47:46.929057 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:46.929002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"28d4b05c20541f708e3a66a9dbabbbdc21f94e9182139d4b9811e813122838f8"} Jul 22 01:47:47.943677 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:47.943624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" event={"ID":"7609d42ab4a2029c30229f73c41e2b48","Type":"ContainerStarted","Data":"b7705049baf427de2b1881e757847ad54ab77419b19a2fd6c5c4e2182985ea3e"} Jul 22 01:47:48.262656 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.262550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:48.262861 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.262834 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:48.263003 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.262913 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:52.262891437 +0000 UTC m=+9.943546972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:48.364107 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.363308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:48.364107 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.363526 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:48.364107 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.363601 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:52.363578842 +0000 UTC m=+10.044234375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:48.464964 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.464057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:48.464964 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.464278 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:48.464964 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.464301 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:48.464964 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.464317 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:48.464964 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.464391 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:52.464367125 +0000 UTC m=+10.145022661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:48.752647 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.751932 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:48.752647 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.752113 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:48.752647 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.752516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:48.752647 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:48.752616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:48.753071 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.752751 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:48.753071 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:48.752865 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:50.750518 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:50.750483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:50.751040 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:50.750639 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:50.751143 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:50.751098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:50.751417 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:50.751224 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:50.751417 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:50.751292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:50.751417 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:50.751369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:52.300625 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.300584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:52.301114 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.300757 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:52.301114 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.300808 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:00.300793494 +0000 UTC m=+17.981449026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:52.401156 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.401016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:52.401359 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.401162 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:52.401359 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.401255 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:00.401233125 +0000 UTC m=+18.081888656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:52.501758 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.501670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:52.501960 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.501849 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:52.501960 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.501890 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:52.501960 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.501904 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:52.502124 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.501965 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:00.501946577 +0000 UTC m=+18.182602114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:52.749599 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.749512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:52.749777 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.749642 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:52.750033 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.750018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:52.750127 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.750110 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:52.750214 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:52.750186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:52.750356 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:52.750306 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:54.749119 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:54.749018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:54.749577 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:54.749185 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:54.749643 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:54.749600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:54.749712 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:54.749695 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:54.749879 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:54.749840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:54.749978 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:54.749959 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:56.749200 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:56.749163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:56.749646 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:56.749164 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:56.750343 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:56.749163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:56.750343 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:56.749724 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:47:56.750343 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:56.750193 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:56.752008 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:56.750540 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:58.748980 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:58.748940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:47:58.749457 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:58.748940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:47:58.749457 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:58.749066 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:47:58.749457 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:58.749159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:47:58.749457 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:47:58.748944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:47:58.749457 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:47:58.749272 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:00.366556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.366444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:00.367218 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.366654 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:48:00.367218 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.366745 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:16.366720976 +0000 UTC m=+34.047376509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:48:00.467403 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.467358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:00.467599 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.467521 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:48:00.467599 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.467593 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:16.467574083 +0000 UTC m=+34.148229612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:48:00.568612 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.568573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:00.568797 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.568710 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:48:00.568797 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.568725 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:48:00.568797 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.568736 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:48:00.568797 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.568785 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:16.568771985 +0000 UTC m=+34.249427517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:48:00.748590 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.748515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:00.748741 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.748521 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:00.748741 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.748619 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:00.748741 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:00.748520 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:00.748922 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.748702 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:00.748922 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:00.748823 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:02.750208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:02.750318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:02.750334 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:02.750386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:02.750391 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:02.750771 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:02.750514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:04.748933 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:04.748892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:04.748933 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:04.748934 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:04.749568 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:04.748893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:04.749568 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:04.749053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:04.749568 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:04.749167 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:04.749568 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:04.749258 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:05.986110 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.985685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dmmrv" event={"ID":"21093df0-5e58-470e-9d25-a256f6d3c6fe","Type":"ContainerStarted","Data":"16ccff8d04dd61aecee35bd42ddb7babc85566b11549b98cf38caa625cdd0d0f"} Jul 22 01:48:05.987283 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.987251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6zpb" event={"ID":"645102e9-2138-44ba-9fc0-1a739c7d8293","Type":"ContainerStarted","Data":"0bcd436dcbbed9ac89527d7d406800087ce0757bf5a4a89ccab729f389e24d73"} Jul 22 01:48:05.988606 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.988580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" event={"ID":"5bc949b4-2895-4665-97ac-38014c3bdb96","Type":"ContainerStarted","Data":"e834c430347ff7f74c1321eccfec55f2d62cbc5138229d11597e19529cd992f5"} Jul 22 01:48:05.990054 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.990019 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmgp6" event={"ID":"3f3d1d24-3406-41f9-a078-53d752d856c8","Type":"ContainerStarted","Data":"b247a7cb847755ddd68f7b4c53340760a80d229f306072b6c395cacbd52dc471"} Jul 22 01:48:05.991458 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.991429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d56zk" event={"ID":"17d355d5-f3da-4c24-8c70-c1d3b1e9a675","Type":"ContainerStarted","Data":"2c6b6f986513e3d7538da85a374c29ccdd2d15ef6d11d4c662d5ebad5c463dd6"} Jul 22 01:48:05.992844 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.992821 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="29d44b5a6df1ef20a644520f5060ca2e0fa17d90e802819338eb59ed4ed02acf" exitCode=0 Jul 22 01:48:05.992976 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.992894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"29d44b5a6df1ef20a644520f5060ca2e0fa17d90e802819338eb59ed4ed02acf"} Jul 22 01:48:05.994771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.994738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" event={"ID":"4a53eca3-2480-48f7-86bf-f1ea098d7265","Type":"ContainerStarted","Data":"3180cf5f9ad12bcc15b1f3c24f8ecad407c6dd2aa13cde73f71272e06c03b666"} Jul 22 01:48:05.996767 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.996745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"679b6ba05e632be25da95206112bdc9d51257250f5845c7cd8ca0d803bfd1540"} Jul 22 01:48:05.996848 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.996803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"816bbec23e87f7775f540647777f30bb0cad4439159222a5cdf7cf3c0208013b"} Jul 22 01:48:05.996848 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:05.996832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"62106911502a48ff257f3acd3680c2c83d8dd227bc89c89490ec52429c6e7f31"} Jul 22 01:48:06.006000 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.004003 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-26.ec2.internal" podStartSLOduration=22.003983839 podStartE2EDuration="22.003983839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:47.961612394 +0000 UTC m=+5.642267952" watchObservedRunningTime="2026-07-22 01:48:06.003983839 +0000 UTC m=+23.684639390" Jul 22 01:48:06.006000 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.004121 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dmmrv" podStartSLOduration=3.237181281 podStartE2EDuration="23.004113822s" totalImagesPullingTime="19.766932541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:06.002855203 +0000 UTC m=+23.683510753" watchObservedRunningTime="2026-07-22 01:48:06.004113822 +0000 UTC m=+23.684769373" Jul 22 01:48:06.023932 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.023857 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wj8j5" podStartSLOduration=3.30824096 podStartE2EDuration="23.023845659s" totalImagesPullingTime="19.715604699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:06.023823085 +0000 UTC m=+23.704478636" watchObservedRunningTime="2026-07-22 01:48:06.023845659 +0000 UTC m=+23.704501209" Jul 22 01:48:06.037948 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.037887 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x6zpb" podStartSLOduration=7.095868236 podStartE2EDuration="23.037842826s" totalImagesPullingTime="15.94197459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:06.037633309 +0000 UTC m=+23.718288860" watchObservedRunningTime="2026-07-22 01:48:06.037842826 +0000 UTC m=+23.718498375" Jul 22 01:48:06.075924 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.075856 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d56zk" podStartSLOduration=3.34182625 podStartE2EDuration="23.075837804s" totalImagesPullingTime="19.734011554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:06.05382472 +0000 UTC m=+23.734480270" watchObservedRunningTime="2026-07-22 01:48:06.075837804 +0000 UTC m=+23.756493357" Jul 22 01:48:06.090019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.089967 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cmgp6" podStartSLOduration=3.378029038 podStartE2EDuration="23.0899495s" totalImagesPullingTime="19.711920462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:06.089653804 +0000 UTC m=+23.770309354" watchObservedRunningTime="2026-07-22 01:48:06.0899495 +0000 UTC m=+23.770605049" Jul 22 01:48:06.748899 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.748840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:06.749254 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:06.749006 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:06.749446 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.749428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:06.749568 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:06.749547 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:06.749774 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.749730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:06.749917 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:06.749885 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:06.995250 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.995215 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 01:48:06.996167 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.996132 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:48:06.996714 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:06.996695 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:48:07.003756 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.003729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" event={"ID":"4a53eca3-2480-48f7-86bf-f1ea098d7265","Type":"ContainerStarted","Data":"1cae15a801527d97f16ab0de71eb681990fd1b3fee61e881c9931b6021e21f63"} Jul 22 01:48:07.012094 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.012056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"9c5689e4fa7398d167fd2372a28fdb26b1d0f1b359869052fabb632ea67a3cf5"} Jul 22 01:48:07.012307 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.012145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"6672be4ce9401ceaf717738d5e43e2d397c3112e3b50ff4c57676b360390fcf5"} Jul 22 01:48:07.012307 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.012188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"a1f66006a1c34adf954b34d0b8390f09d260be612576306d567c8178dc5a8739"} Jul 22 01:48:07.685373 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.685241 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T01:48:06.995243798Z","UUID":"fa8563ba-055a-4693-8f22-73dc2c72f068","Handler":null,"Name":"","Endpoint":""} Jul 22 01:48:07.687301 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.687269 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 01:48:07.687491 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:07.687325 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 01:48:08.016815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.016710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l2jdt" event={"ID":"b9cadc2e-8357-47e3-a826-24655eff089f","Type":"ContainerStarted","Data":"d3fd0e3fc96fe3e8db6e130ddc3f077dc840334abca63c4a3ea1ceb208e5b4a5"} Jul 22 01:48:08.017455 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.016815 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 01:48:08.040026 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.039963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l2jdt" podStartSLOduration=5.349672276 podStartE2EDuration="25.039944089s" totalImagesPullingTime="19.690271813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:08.03969953 +0000 UTC m=+25.720355081" watchObservedRunningTime="2026-07-22 01:48:08.039944089 +0000 UTC m=+25.720599639" Jul 22 01:48:08.749386 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.749298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:08.749386 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.749342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:08.749386 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:08.749306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:08.749624 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:08.749454 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:08.749624 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:08.749590 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:08.749702 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:08.749680 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:09.021846 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.021749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" event={"ID":"4a53eca3-2480-48f7-86bf-f1ea098d7265","Type":"ContainerStarted","Data":"3794b9206b57565f3f089057726926919e9a495d34fece8a2559198f990ccdf2"} Jul 22 01:48:09.025685 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.025648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"5d79dff335fe6c18a4500d8499731e4d36a86be5271fbe1b6d7368c83fb86b68"} Jul 22 01:48:09.039567 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.039507 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwn8l" podStartSLOduration=4.126647789 podStartE2EDuration="26.039488647s" totalImagesPullingTime="21.912840858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:09.03909013 +0000 UTC m=+26.719745685" watchObservedRunningTime="2026-07-22 01:48:09.039488647 +0000 UTC m=+26.720144198" Jul 22 01:48:09.209293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.209246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:48:09.209486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.209418 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 01:48:09.210089 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:09.210068 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x6zpb" Jul 22 01:48:10.749424 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:10.748994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:10.749424 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:10.748998 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:10.749424 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:10.749380 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:10.749424 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:10.749056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:10.751255 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:10.749484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:10.751255 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:10.749597 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:11.032096 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.032006 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="88e09fd02a8f7df74d342bcf99e7594e89d3793edc852cb6da805256bc2eab3f" exitCode=0 Jul 22 01:48:11.032248 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.032094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"88e09fd02a8f7df74d342bcf99e7594e89d3793edc852cb6da805256bc2eab3f"} Jul 22 01:48:11.038361 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.038332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" event={"ID":"bbd5a50b-7945-4046-9563-fde8e90e0faf","Type":"ContainerStarted","Data":"3fb355e1c241686b2fff93610a0b4c20d843d3744d10495d7f6a6c6247c65c19"} Jul 22 01:48:11.038713 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.038609 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:11.038713 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.038673 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:11.055846 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.055816 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:11.078078 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.078027 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" podStartSLOduration=8.278894289 podStartE2EDuration="28.078010238s" totalImagesPullingTime="19.799115949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:11.077710033 +0000 UTC m=+28.758365583" watchObservedRunningTime="2026-07-22 01:48:11.078010238 +0000 UTC m=+28.758665838" Jul 22 01:48:11.311743 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:11.311508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmgp6_3f3d1d24-3406-41f9-a078-53d752d856c8/dns-node-resolver/0.log" Jul 22 01:48:12.041081 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.041048 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:12.063043 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.063019 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:12.293075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.293011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d56zk_17d355d5-f3da-4c24-8c70-c1d3b1e9a675/node-ca/0.log" Jul 22 01:48:12.671296 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.671209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nx9v7"] Jul 22 01:48:12.671449 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.671340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:12.671503 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:12.671447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:12.680185 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.680153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wthqb"] Jul 22 01:48:12.680353 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.680295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:12.680466 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:12.680438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:12.681635 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.680806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g89k2"] Jul 22 01:48:12.681635 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:12.680916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:12.681635 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:12.681009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:13.044681 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:13.044588 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="be3399da3398a1c364a55f232cee77cbd7f6cf3e0451132dc4ff3147409ecb55" exitCode=0 Jul 22 01:48:13.045220 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:13.044679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"be3399da3398a1c364a55f232cee77cbd7f6cf3e0451132dc4ff3147409ecb55"} Jul 22 01:48:14.049075 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:14.049031 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="82789b4c49d5492316f6c40ead85c2fcbc051ae7f6e8aec7771b42321ebbd42e" exitCode=0 Jul 22 01:48:14.049559 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:14.049114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"82789b4c49d5492316f6c40ead85c2fcbc051ae7f6e8aec7771b42321ebbd42e"} Jul 22 01:48:14.748944 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:14.748911 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:14.749124 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:14.748911 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:14.749124 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:14.749049 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:14.749124 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:14.749065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:14.749285 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:14.749150 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:14.749285 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:14.749218 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:16.394462 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.394214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:16.394462 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.394376 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:48:16.394999 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.394547 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs podName:f622e6fa-da66-4557-9fc0-0d441cde2ea8 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:48.394526435 +0000 UTC m=+66.075181968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs") pod "network-metrics-daemon-wthqb" (UID: "f622e6fa-da66-4557-9fc0-0d441cde2ea8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:48:16.495781 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.495736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:16.495998 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.495940 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:48:16.496071 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.496022 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret podName:e34f5790-2bd6-4705-8140-768ecb509768 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:48.496004132 +0000 UTC m=+66.176659660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret") pod "global-pull-secret-syncer-g89k2" (UID: "e34f5790-2bd6-4705-8140-768ecb509768") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:48:16.597101 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.597050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:16.597319 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.597279 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:48:16.597319 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.597306 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:48:16.597319 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.597320 2564 projected.go:196] Error preparing data for projected volume kube-api-access-zrw49 for pod openshift-network-diagnostics/network-check-target-nx9v7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:48:16.597463 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.597394 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49 podName:f1280b72-a5be-40b2-8b0a-77b1a59a9314 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:48.59737281 +0000 UTC m=+66.278028343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrw49" (UniqueName: "kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49") pod "network-check-target-nx9v7" (UID: "f1280b72-a5be-40b2-8b0a-77b1a59a9314") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:48:16.749184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.749085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:16.749184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.749114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:16.749184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:16.749085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:16.749422 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.749247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:16.749422 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.749370 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:16.749509 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:16.749458 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:18.749267 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:18.749226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:18.749761 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:18.749223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:18.749761 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:18.749358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:18.749761 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:18.749369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:18.749761 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:18.749442 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:18.749761 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:18.749527 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:20.067390 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:20.067353 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="3f5a241c1f0d4b150baa1f70d8b38250409bc9d2530b6c8b3b0abc6faa6fde84" exitCode=0 Jul 22 01:48:20.067923 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:20.067424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"3f5a241c1f0d4b150baa1f70d8b38250409bc9d2530b6c8b3b0abc6faa6fde84"} Jul 22 01:48:20.748779 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:20.748736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:20.749023 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:20.748734 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:20.749023 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:20.748737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:20.749023 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:20.748940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:20.749023 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:20.748903 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:20.749229 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:20.749009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:21.072848 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:21.072759 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5426e0-f5ca-4c8b-a243-942cc835dc9a" containerID="39e90fc9800709ab81b1306b6aee328e3b01418df376efbe8ca036b977f95946" exitCode=0 Jul 22 01:48:21.072848 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:21.072833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerDied","Data":"39e90fc9800709ab81b1306b6aee328e3b01418df376efbe8ca036b977f95946"} Jul 22 01:48:22.079087 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:22.079051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jsc72" event={"ID":"1d5426e0-f5ca-4c8b-a243-942cc835dc9a","Type":"ContainerStarted","Data":"1d809623f90a14b343959c4f990508670abcd8b28d82de9624b18fdc39fd20e4"} Jul 22 01:48:22.100468 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:22.100378 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jsc72" podStartSLOduration=7.93203363 podStartE2EDuration="39.100359662s" totalImagesPullingTime="31.168326032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:22.099979874 +0000 UTC m=+39.780635441" watchObservedRunningTime="2026-07-22 01:48:22.100359662 +0000 UTC m=+39.781015211" Jul 22 01:48:22.749980 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:22.749945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:22.750167 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:22.750039 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:22.750167 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:22.750051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:22.750244 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:22.750190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:22.750244 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:22.750194 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:22.750310 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:22.750246 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:24.749006 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:24.748962 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:24.749556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:24.748963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:24.749556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:24.749115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:24.749556 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:24.749083 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:24.749556 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:24.749231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:24.749556 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:24.749265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:26.748653 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:26.748602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:26.749105 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:26.748599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:26.749105 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:26.748740 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:26.749105 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:26.748616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:26.749105 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:26.748824 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:26.749105 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:26.748902 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:28.749152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:28.749117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:28.749152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:28.749123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:28.749733 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:28.749314 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:28.749733 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:28.749343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:28.749733 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:28.749423 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:28.749733 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:28.749510 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:30.748737 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:30.748702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:30.749151 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:30.748743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:30.749151 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:30.748702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:30.749151 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:30.748823 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:30.749151 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:30.748886 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:30.749151 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:30.748942 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:32.749941 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:32.749906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:32.750362 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:32.749951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:32.750362 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:32.749997 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx9v7" podUID="f1280b72-a5be-40b2-8b0a-77b1a59a9314" Jul 22 01:48:32.750362 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:32.750052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g89k2" podUID="e34f5790-2bd6-4705-8140-768ecb509768" Jul 22 01:48:32.750362 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:32.750123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:32.750362 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:32.750248 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wthqb" podUID="f622e6fa-da66-4557-9fc0-0d441cde2ea8" Jul 22 01:48:33.192412 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.192382 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-26.ec2.internal" event="NodeReady" Jul 22 01:48:33.192600 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.192557 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 01:48:33.244148 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.244109 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mzfrd"] Jul 22 01:48:33.257097 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.257069 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wmfwx"] Jul 22 01:48:33.257244 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.257196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.260284 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.260256 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 01:48:33.260435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.260325 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 01:48:33.260435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.260333 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 01:48:33.260435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.260343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v5h9n\"" Jul 22 01:48:33.267076 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.267043 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzfrd"] Jul 22 01:48:33.267222 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.267182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.270458 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.270419 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 01:48:33.270852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.270835 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 01:48:33.270979 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.270842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2nw2\"" Jul 22 01:48:33.270979 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.270910 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 01:48:33.271406 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.271391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 01:48:33.325717 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.325635 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wmfwx"] Jul 22 01:48:33.349180 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.349149 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-779fj"] Jul 22 01:48:33.371163 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.371123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-779fj"] Jul 22 01:48:33.371343 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.371255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.373787 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.373764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqgw\"" Jul 22 01:48:33.373965 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.373812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 01:48:33.374077 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.374059 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 01:48:33.415879 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.415836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5087a363-18c5-4a56-a31e-4994e82125ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.416069 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.415917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5087a363-18c5-4a56-a31e-4994e82125ce-crio-socket\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.416069 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.415949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5087a363-18c5-4a56-a31e-4994e82125ce-data-volume\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.416069 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.415966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5087a363-18c5-4a56-a31e-4994e82125ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.416069 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.415994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgt99\" (UniqueName: \"kubernetes.io/projected/5087a363-18c5-4a56-a31e-4994e82125ce-kube-api-access-kgt99\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.416069 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.416060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ca0685-72f9-49c3-918a-90d34c3252dc-cert\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.416228 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.416082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftl2g\" (UniqueName: \"kubernetes.io/projected/f1ca0685-72f9-49c3-918a-90d34c3252dc-kube-api-access-ftl2g\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.517226 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5087a363-18c5-4a56-a31e-4994e82125ce-data-volume\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517226 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5087a363-18c5-4a56-a31e-4994e82125ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgt99\" (UniqueName: \"kubernetes.io/projected/5087a363-18c5-4a56-a31e-4994e82125ce-kube-api-access-kgt99\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f082bd62-ee51-47a5-9e65-2ff9636edf5c-metrics-tls\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.517476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ca0685-72f9-49c3-918a-90d34c3252dc-cert\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.517476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftl2g\" (UniqueName: \"kubernetes.io/projected/f1ca0685-72f9-49c3-918a-90d34c3252dc-kube-api-access-ftl2g\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.517476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f082bd62-ee51-47a5-9e65-2ff9636edf5c-tmp-dir\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.517722 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5087a363-18c5-4a56-a31e-4994e82125ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517722 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f082bd62-ee51-47a5-9e65-2ff9636edf5c-config-volume\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.517722 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5087a363-18c5-4a56-a31e-4994e82125ce-crio-socket\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517722 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzp2\" (UniqueName: \"kubernetes.io/projected/f082bd62-ee51-47a5-9e65-2ff9636edf5c-kube-api-access-5mzp2\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.517722 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5087a363-18c5-4a56-a31e-4994e82125ce-data-volume\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.517983 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.517757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5087a363-18c5-4a56-a31e-4994e82125ce-crio-socket\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.518187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.518164 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5087a363-18c5-4a56-a31e-4994e82125ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.521634 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.521610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5087a363-18c5-4a56-a31e-4994e82125ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.521757 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.521651 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1ca0685-72f9-49c3-918a-90d34c3252dc-cert\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.526521 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.526484 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgt99\" (UniqueName: \"kubernetes.io/projected/5087a363-18c5-4a56-a31e-4994e82125ce-kube-api-access-kgt99\") pod \"insights-runtime-extractor-wmfwx\" (UID: \"5087a363-18c5-4a56-a31e-4994e82125ce\") " pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.526768 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.526746 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftl2g\" (UniqueName: \"kubernetes.io/projected/f1ca0685-72f9-49c3-918a-90d34c3252dc-kube-api-access-ftl2g\") pod \"ingress-canary-mzfrd\" (UID: \"f1ca0685-72f9-49c3-918a-90d34c3252dc\") " pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.567447 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.567400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzfrd" Jul 22 01:48:33.575692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.575615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wmfwx" Jul 22 01:48:33.618299 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.618266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzp2\" (UniqueName: \"kubernetes.io/projected/f082bd62-ee51-47a5-9e65-2ff9636edf5c-kube-api-access-5mzp2\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.618465 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.618321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f082bd62-ee51-47a5-9e65-2ff9636edf5c-metrics-tls\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.618465 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.618397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f082bd62-ee51-47a5-9e65-2ff9636edf5c-tmp-dir\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.618465 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.618445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f082bd62-ee51-47a5-9e65-2ff9636edf5c-config-volume\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.618943 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.618917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f082bd62-ee51-47a5-9e65-2ff9636edf5c-tmp-dir\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.619128 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.619108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f082bd62-ee51-47a5-9e65-2ff9636edf5c-config-volume\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.620942 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.620916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f082bd62-ee51-47a5-9e65-2ff9636edf5c-metrics-tls\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.625984 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.625950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzp2\" (UniqueName: \"kubernetes.io/projected/f082bd62-ee51-47a5-9e65-2ff9636edf5c-kube-api-access-5mzp2\") pod \"dns-default-779fj\" (UID: \"f082bd62-ee51-47a5-9e65-2ff9636edf5c\") " pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.682940 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.682904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-779fj" Jul 22 01:48:33.805564 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.805527 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wmfwx"] Jul 22 01:48:33.810544 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:33.810507 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5087a363_18c5_4a56_a31e_4994e82125ce.slice/crio-507270cad892c038731a03e9c77d4b7f75d0085718b63c062e7109afe59a35a6 WatchSource:0}: Error finding container 507270cad892c038731a03e9c77d4b7f75d0085718b63c062e7109afe59a35a6: Status 404 returned error can't find the container with id 507270cad892c038731a03e9c77d4b7f75d0085718b63c062e7109afe59a35a6 Jul 22 01:48:33.818056 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.818026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzfrd"] Jul 22 01:48:33.822604 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:33.822560 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ca0685_72f9_49c3_918a_90d34c3252dc.slice/crio-17474980f425e4ca5b4e820e8659c5c164d0be35074c30a0ffe70ea6b4ea84cd WatchSource:0}: Error finding container 17474980f425e4ca5b4e820e8659c5c164d0be35074c30a0ffe70ea6b4ea84cd: Status 404 returned error can't find the container with id 17474980f425e4ca5b4e820e8659c5c164d0be35074c30a0ffe70ea6b4ea84cd Jul 22 01:48:33.858416 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:33.858325 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-779fj"] Jul 22 01:48:33.862049 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:33.862020 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf082bd62_ee51_47a5_9e65_2ff9636edf5c.slice/crio-b37633fb1af03f299e6d9b086c9bbb8022b2969a59996dcca01526d2cae5e160 WatchSource:0}: Error finding container b37633fb1af03f299e6d9b086c9bbb8022b2969a59996dcca01526d2cae5e160: Status 404 returned error can't find the container with id b37633fb1af03f299e6d9b086c9bbb8022b2969a59996dcca01526d2cae5e160 Jul 22 01:48:34.111589 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.111484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzfrd" event={"ID":"f1ca0685-72f9-49c3-918a-90d34c3252dc","Type":"ContainerStarted","Data":"17474980f425e4ca5b4e820e8659c5c164d0be35074c30a0ffe70ea6b4ea84cd"} Jul 22 01:48:34.112601 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.112569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-779fj" event={"ID":"f082bd62-ee51-47a5-9e65-2ff9636edf5c","Type":"ContainerStarted","Data":"b37633fb1af03f299e6d9b086c9bbb8022b2969a59996dcca01526d2cae5e160"} Jul 22 01:48:34.113580 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.113553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wmfwx" event={"ID":"5087a363-18c5-4a56-a31e-4994e82125ce","Type":"ContainerStarted","Data":"507270cad892c038731a03e9c77d4b7f75d0085718b63c062e7109afe59a35a6"} Jul 22 01:48:34.750062 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.749009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:34.750062 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.749551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:34.751114 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.751075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:34.756557 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.756529 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:48:34.756910 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.756882 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:48:34.757155 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.757137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rnbhf\"" Jul 22 01:48:34.757556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.757264 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:48:34.757556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.757369 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6r65\"" Jul 22 01:48:34.757556 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:34.757142 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:48:37.038291 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.038257 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:48:37.049631 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.049601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.054039 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.053971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:48:37.055250 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.055224 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 01:48:37.055513 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.055494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lhqmk\"" Jul 22 01:48:37.055625 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.055532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 01:48:37.055692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.055650 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 01:48:37.055775 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.055759 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 01:48:37.056565 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.056543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 01:48:37.056670 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.056545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 01:48:37.057179 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.057161 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 01:48:37.148276 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.148435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.148435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lckdt\" (UniqueName: \"kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.148525 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.148525 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.148525 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.148512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.249939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.249694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.249939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.249777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.249939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.249815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.249939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.249853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.250291 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.249993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.250291 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.250049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lckdt\" (UniqueName: \"kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.252906 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.251320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.254277 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.254244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.254410 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.254260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.254410 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.254322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.255596 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.255570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.260372 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.260337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lckdt\" (UniqueName: \"kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt\") pod \"console-78f8fd78c5-qbxhj\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:37.361142 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:37.361048 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:38.809945 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:38.809899 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:48:38.975147 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:38.975108 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:48:38.975339 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:38.975244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:38.984157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:38.984126 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 01:48:39.066227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2g4\" (UniqueName: \"kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.066486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.066439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167433 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167433 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167693 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167775 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2g4\" (UniqueName: \"kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167843 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167925 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.167925 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.167903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.168457 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.168429 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.168893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.168825 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.168893 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.168854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.169738 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.169712 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.171175 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.171152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.171175 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.171162 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.175619 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.175593 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2g4\" (UniqueName: \"kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4\") pod \"console-7dbfff9b87-j7qjz\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:39.287674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:39.287629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:40.586263 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:40.586231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:48:40.590428 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:40.590400 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1603b8_e079_4231_b3ad_ce7da9be8066.slice/crio-7dbabcbc120f45fafb58a130bd3e8be8bd1b276e57ab1d52df0bf5a0494621df WatchSource:0}: Error finding container 7dbabcbc120f45fafb58a130bd3e8be8bd1b276e57ab1d52df0bf5a0494621df: Status 404 returned error can't find the container with id 7dbabcbc120f45fafb58a130bd3e8be8bd1b276e57ab1d52df0bf5a0494621df Jul 22 01:48:40.600352 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:40.600322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:48:40.751673 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:40.751592 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c338022_5267_416a_8e75_0639005bed4a.slice/crio-236a8fc64b58aa27e4100a01a7d2a9e4500572315a8a1fb2468ac946fad4e124 WatchSource:0}: Error finding container 236a8fc64b58aa27e4100a01a7d2a9e4500572315a8a1fb2468ac946fad4e124: Status 404 returned error can't find the container with id 236a8fc64b58aa27e4100a01a7d2a9e4500572315a8a1fb2468ac946fad4e124 Jul 22 01:48:41.133936 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.133833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbfff9b87-j7qjz" event={"ID":"1a1603b8-e079-4231-b3ad-ce7da9be8066","Type":"ContainerStarted","Data":"7dbabcbc120f45fafb58a130bd3e8be8bd1b276e57ab1d52df0bf5a0494621df"} Jul 22 01:48:41.135307 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.135278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wmfwx" event={"ID":"5087a363-18c5-4a56-a31e-4994e82125ce","Type":"ContainerStarted","Data":"4bde1f53184f93b2dea773796cd04e1ec5f9c49cab510d8a1e96bfaa7abac479"} Jul 22 01:48:41.136728 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.136693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzfrd" event={"ID":"f1ca0685-72f9-49c3-918a-90d34c3252dc","Type":"ContainerStarted","Data":"e067dffe860076865d470efb10720f009b74cd5d94f6390154a2110e4a113f35"} Jul 22 01:48:41.138537 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.138507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-779fj" event={"ID":"f082bd62-ee51-47a5-9e65-2ff9636edf5c","Type":"ContainerStarted","Data":"064f5ac9d127180c4a89cad7b55edbf0166759a09d2d49ed1de9ec3b1d9502c5"} Jul 22 01:48:41.138666 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.138554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-779fj" event={"ID":"f082bd62-ee51-47a5-9e65-2ff9636edf5c","Type":"ContainerStarted","Data":"3804472c58095c53e74abc0b3944f32d1beefa611430fa0b2f8df6c60b83730e"} Jul 22 01:48:41.138666 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.138592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-779fj" Jul 22 01:48:41.139877 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.139838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8fd78c5-qbxhj" event={"ID":"7c338022-5267-416a-8e75-0639005bed4a","Type":"ContainerStarted","Data":"236a8fc64b58aa27e4100a01a7d2a9e4500572315a8a1fb2468ac946fad4e124"} Jul 22 01:48:41.151795 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.151752 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mzfrd" podStartSLOduration=1.544307855 podStartE2EDuration="8.151736446s" totalImagesPullingTime="6.607428591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:41.150641378 +0000 UTC m=+58.831296905" watchObservedRunningTime="2026-07-22 01:48:41.151736446 +0000 UTC m=+58.832391996" Jul 22 01:48:41.166481 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:41.166423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-779fj" podStartSLOduration=1.59946221 podStartE2EDuration="8.166403966s" totalImagesPullingTime="6.566941756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:41.165888792 +0000 UTC m=+58.846544333" watchObservedRunningTime="2026-07-22 01:48:41.166403966 +0000 UTC m=+58.847059510" Jul 22 01:48:43.708589 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.708549 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8"] Jul 22 01:48:43.721207 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.721168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:43.724430 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.724400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6ng6d\"" Jul 22 01:48:43.724705 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.724683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 22 01:48:43.735919 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.735891 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8"] Jul 22 01:48:43.808958 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.808917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b3d5e53-aaac-4973-9c1d-54f37a3e11d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-784k8\" (UID: \"5b3d5e53-aaac-4973-9c1d-54f37a3e11d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:43.909512 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.909465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b3d5e53-aaac-4973-9c1d-54f37a3e11d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-784k8\" (UID: \"5b3d5e53-aaac-4973-9c1d-54f37a3e11d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:43.912786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:43.912736 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b3d5e53-aaac-4973-9c1d-54f37a3e11d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-784k8\" (UID: \"5b3d5e53-aaac-4973-9c1d-54f37a3e11d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:44.032677 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:44.032587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:44.061678 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:44.061639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgqbp" Jul 22 01:48:46.086037 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.085997 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8"] Jul 22 01:48:46.157257 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.157204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8fd78c5-qbxhj" event={"ID":"7c338022-5267-416a-8e75-0639005bed4a","Type":"ContainerStarted","Data":"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3"} Jul 22 01:48:46.158547 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.158507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" event={"ID":"5b3d5e53-aaac-4973-9c1d-54f37a3e11d3","Type":"ContainerStarted","Data":"3262e49f388250010739bba3226d609363cbb279f5c5b755f75a32a20cc7e5be"} Jul 22 01:48:46.161839 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.161241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbfff9b87-j7qjz" event={"ID":"1a1603b8-e079-4231-b3ad-ce7da9be8066","Type":"ContainerStarted","Data":"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495"} Jul 22 01:48:46.163698 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.163659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wmfwx" event={"ID":"5087a363-18c5-4a56-a31e-4994e82125ce","Type":"ContainerStarted","Data":"3e406c99f53190e387a0e3cdeb1b0656864f3a97d7c1b42b3abef27a3392e57f"} Jul 22 01:48:46.174133 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.174077 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f8fd78c5-qbxhj" podStartSLOduration=4.006759108 podStartE2EDuration="9.17406126s" totalImagesPullingTime="5.167302152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:46.173105163 +0000 UTC m=+63.853760737" watchObservedRunningTime="2026-07-22 01:48:46.17406126 +0000 UTC m=+63.854716810" Jul 22 01:48:46.192956 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:46.192901 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dbfff9b87-j7qjz" podStartSLOduration=2.844875997 podStartE2EDuration="8.192855848s" totalImagesPullingTime="5.347979851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:46.191994749 +0000 UTC m=+63.872650298" watchObservedRunningTime="2026-07-22 01:48:46.192855848 +0000 UTC m=+63.873511395" Jul 22 01:48:47.362112 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:47.362072 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:47.362577 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:47.362181 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:47.363963 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:47.363906 2564 patch_prober.go:28] interesting pod/console-78f8fd78c5-qbxhj container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.135.0.9:8443/health\": dial tcp 10.135.0.9:8443: connect: connection refused" start-of-body= Jul 22 01:48:47.364133 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:47.363983 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78f8fd78c5-qbxhj" podUID="7c338022-5267-416a-8e75-0639005bed4a" containerName="console" probeResult="failure" output="Get \"https://10.135.0.9:8443/health\": dial tcp 10.135.0.9:8443: connect: connection refused" Jul 22 01:48:48.174029 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.173986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" event={"ID":"5b3d5e53-aaac-4973-9c1d-54f37a3e11d3","Type":"ContainerStarted","Data":"9084d1f8e11cee30c682a0a78b6d56fbd2d5802db590f1f9127d4a3840cffafa"} Jul 22 01:48:48.189724 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.189657 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" podStartSLOduration=4.058846424 podStartE2EDuration="5.189633048s" totalImagesPullingTime="1.130786624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:48.189019221 +0000 UTC m=+65.869674769" watchObservedRunningTime="2026-07-22 01:48:48.189633048 +0000 UTC m=+65.870288598" Jul 22 01:48:48.453326 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.453236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:48.456056 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.456029 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:48:48.466737 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.466675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f622e6fa-da66-4557-9fc0-0d441cde2ea8-metrics-certs\") pod \"network-metrics-daemon-wthqb\" (UID: \"f622e6fa-da66-4557-9fc0-0d441cde2ea8\") " pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:48.553693 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.553636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:48.556545 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.556516 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:48:48.568332 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.568296 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e34f5790-2bd6-4705-8140-768ecb509768-original-pull-secret\") pod \"global-pull-secret-syncer-g89k2\" (UID: \"e34f5790-2bd6-4705-8140-768ecb509768\") " pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:48.569766 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.569742 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rnbhf\"" Jul 22 01:48:48.577971 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.577849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wthqb" Jul 22 01:48:48.587132 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.587093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g89k2" Jul 22 01:48:48.654196 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.654162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:48.656876 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.656847 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:48:48.667459 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.667426 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:48:48.679152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.679113 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrw49\" (UniqueName: \"kubernetes.io/projected/f1280b72-a5be-40b2-8b0a-77b1a59a9314-kube-api-access-zrw49\") pod \"network-check-target-nx9v7\" (UID: \"f1280b72-a5be-40b2-8b0a-77b1a59a9314\") " pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:48.881935 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.881836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6r65\"" Jul 22 01:48:48.889186 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:48.889145 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:49.178361 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.178328 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:49.183963 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.183929 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-784k8" Jul 22 01:48:49.288381 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.288338 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:49.288586 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.288409 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:49.290054 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.290021 2564 patch_prober.go:28] interesting pod/console-7dbfff9b87-j7qjz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.135.0.10:8443/health\": dial tcp 10.135.0.10:8443: connect: connection refused" start-of-body= Jul 22 01:48:49.290217 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.290075 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dbfff9b87-j7qjz" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerName="console" probeResult="failure" output="Get \"https://10.135.0.10:8443/health\": dial tcp 10.135.0.10:8443: connect: connection refused" Jul 22 01:48:49.656241 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.656204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g89k2"] Jul 22 01:48:49.660150 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:49.660115 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34f5790_2bd6_4705_8140_768ecb509768.slice/crio-c11b45dbb2e1fc391e1c9f5c60db24ff9910d07157d740fd0631fd9c2feda5f6 WatchSource:0}: Error finding container c11b45dbb2e1fc391e1c9f5c60db24ff9910d07157d740fd0631fd9c2feda5f6: Status 404 returned error can't find the container with id c11b45dbb2e1fc391e1c9f5c60db24ff9910d07157d740fd0631fd9c2feda5f6 Jul 22 01:48:49.685270 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.685243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wthqb"] Jul 22 01:48:49.685892 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:49.685839 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf622e6fa_da66_4557_9fc0_0d441cde2ea8.slice/crio-d122b842aa6b323f419e2fb3441dc15cc000860469b7a60108698084e113ec02 WatchSource:0}: Error finding container d122b842aa6b323f419e2fb3441dc15cc000860469b7a60108698084e113ec02: Status 404 returned error can't find the container with id d122b842aa6b323f419e2fb3441dc15cc000860469b7a60108698084e113ec02 Jul 22 01:48:49.747182 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.745389 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l58mv"] Jul 22 01:48:49.750546 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.750508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.753173 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.753138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 01:48:49.753173 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.753158 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 01:48:49.753380 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.753276 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 01:48:49.754352 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.754295 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 01:48:49.754352 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.754340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rmjd6\"" Jul 22 01:48:49.754838 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.754790 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 01:48:49.756269 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.756245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l58mv"] Jul 22 01:48:49.865783 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.865706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9569065c-83b0-45d3-be71-462847355c87-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.865783 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.865743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxr8\" (UniqueName: \"kubernetes.io/projected/9569065c-83b0-45d3-be71-462847355c87-kube-api-access-hhxr8\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.865783 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.865772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.866012 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.865900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.882138 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.882103 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nx9v7"] Jul 22 01:48:49.886956 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:49.886917 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1280b72_a5be_40b2_8b0a_77b1a59a9314.slice/crio-9ad3b00460c1b4928ac69104eef1008668e3d1751a7dd6bea6ac92e35406135c WatchSource:0}: Error finding container 9ad3b00460c1b4928ac69104eef1008668e3d1751a7dd6bea6ac92e35406135c: Status 404 returned error can't find the container with id 9ad3b00460c1b4928ac69104eef1008668e3d1751a7dd6bea6ac92e35406135c Jul 22 01:48:49.967292 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.967243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9569065c-83b0-45d3-be71-462847355c87-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.967292 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.967295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxr8\" (UniqueName: \"kubernetes.io/projected/9569065c-83b0-45d3-be71-462847355c87-kube-api-access-hhxr8\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.967554 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.967330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.967554 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.967379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.968009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.967986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9569065c-83b0-45d3-be71-462847355c87-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.970129 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.970104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.970222 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.970104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9569065c-83b0-45d3-be71-462847355c87-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:49.975847 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:49.975818 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxr8\" (UniqueName: \"kubernetes.io/projected/9569065c-83b0-45d3-be71-462847355c87-kube-api-access-hhxr8\") pod \"prometheus-operator-5945b5cfd-l58mv\" (UID: \"9569065c-83b0-45d3-be71-462847355c87\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:50.061470 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.061413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" Jul 22 01:48:50.185663 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.185623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wmfwx" event={"ID":"5087a363-18c5-4a56-a31e-4994e82125ce","Type":"ContainerStarted","Data":"5f894e9c65a136b731e481636946ad033583a7225f3c855b82d5a972fef081d7"} Jul 22 01:48:50.188040 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.188001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthqb" event={"ID":"f622e6fa-da66-4557-9fc0-0d441cde2ea8","Type":"ContainerStarted","Data":"d122b842aa6b323f419e2fb3441dc15cc000860469b7a60108698084e113ec02"} Jul 22 01:48:50.190127 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.190093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g89k2" event={"ID":"e34f5790-2bd6-4705-8140-768ecb509768","Type":"ContainerStarted","Data":"c11b45dbb2e1fc391e1c9f5c60db24ff9910d07157d740fd0631fd9c2feda5f6"} Jul 22 01:48:50.191965 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.191896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nx9v7" event={"ID":"f1280b72-a5be-40b2-8b0a-77b1a59a9314","Type":"ContainerStarted","Data":"9ad3b00460c1b4928ac69104eef1008668e3d1751a7dd6bea6ac92e35406135c"} Jul 22 01:48:50.224398 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.224337 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wmfwx" podStartSLOduration=1.667377104 podStartE2EDuration="17.224319849s" totalImagesPullingTime="15.556942745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:48:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:50.204333752 +0000 UTC m=+67.884989301" watchObservedRunningTime="2026-07-22 01:48:50.224319849 +0000 UTC m=+67.904975389" Jul 22 01:48:50.225041 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:50.225014 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-l58mv"] Jul 22 01:48:50.232996 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:50.232953 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9569065c_83b0_45d3_be71_462847355c87.slice/crio-2a645e846d8d7380479f71762676d10fbc3f192071a18f8fe3d4109e0cce1507 WatchSource:0}: Error finding container 2a645e846d8d7380479f71762676d10fbc3f192071a18f8fe3d4109e0cce1507: Status 404 returned error can't find the container with id 2a645e846d8d7380479f71762676d10fbc3f192071a18f8fe3d4109e0cce1507 Jul 22 01:48:51.146342 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:51.145435 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-779fj" Jul 22 01:48:51.207005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:51.206144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthqb" event={"ID":"f622e6fa-da66-4557-9fc0-0d441cde2ea8","Type":"ContainerStarted","Data":"bbd49a61d5cc91d6d8aad60be6d84dcb30cff905d06a6d610817417e4e4df8b2"} Jul 22 01:48:51.207005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:51.206217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wthqb" event={"ID":"f622e6fa-da66-4557-9fc0-0d441cde2ea8","Type":"ContainerStarted","Data":"fff6c2c859a3686dc7a9e62013a5f03c7a4e7d0de9c115463c8e57cca6ba3c50"} Jul 22 01:48:51.209921 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:51.208817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" event={"ID":"9569065c-83b0-45d3-be71-462847355c87","Type":"ContainerStarted","Data":"2a645e846d8d7380479f71762676d10fbc3f192071a18f8fe3d4109e0cce1507"} Jul 22 01:48:51.223604 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:51.223542 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wthqb" podStartSLOduration=67.159639246 podStartE2EDuration="1m8.223520077s" totalImagesPullingTime="1.063880831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:51.222310819 +0000 UTC m=+68.902966369" watchObservedRunningTime="2026-07-22 01:48:51.223520077 +0000 UTC m=+68.904175631" Jul 22 01:48:55.230070 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.230026 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g89k2" event={"ID":"e34f5790-2bd6-4705-8140-768ecb509768","Type":"ContainerStarted","Data":"7dca7356588c0ab8152f83e0f70202bb834ace6e5fe64b283ec521f54f5a4c7b"} Jul 22 01:48:55.231633 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.231595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nx9v7" event={"ID":"f1280b72-a5be-40b2-8b0a-77b1a59a9314","Type":"ContainerStarted","Data":"9a41a31b670db91121a4679396d40eec97e20a42e54a424fd5cb57b56096adb7"} Jul 22 01:48:55.231772 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.231693 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:48:55.233301 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.233270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" event={"ID":"9569065c-83b0-45d3-be71-462847355c87","Type":"ContainerStarted","Data":"16564736d005ea99ce35f7d0eeae39f7d0a78151a5e41cb86f8e5a158539e760"} Jul 22 01:48:55.233448 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.233322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" event={"ID":"9569065c-83b0-45d3-be71-462847355c87","Type":"ContainerStarted","Data":"0f2a4be2b204c2a50bac456084847f912329df0a17ff05fab02362368a3ee4a2"} Jul 22 01:48:55.246104 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.246051 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g89k2" podStartSLOduration=67.321235926 podStartE2EDuration="1m12.246034317s" totalImagesPullingTime="4.924798391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.245478666 +0000 UTC m=+72.926134214" watchObservedRunningTime="2026-07-22 01:48:55.246034317 +0000 UTC m=+72.926689953" Jul 22 01:48:55.262646 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.262578 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-l58mv" podStartSLOduration=1.9297524510000001 podStartE2EDuration="6.262557035s" totalImagesPullingTime="4.332804584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.262273437 +0000 UTC m=+72.942928987" watchObservedRunningTime="2026-07-22 01:48:55.262557035 +0000 UTC m=+72.943212585" Jul 22 01:48:55.280309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:55.280258 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nx9v7" podStartSLOduration=67.5856873 podStartE2EDuration="1m12.280239318s" totalImagesPullingTime="4.694552018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.279198222 +0000 UTC m=+72.959853772" watchObservedRunningTime="2026-07-22 01:48:55.280239318 +0000 UTC m=+72.960894867" Jul 22 01:48:57.100638 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.100597 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb"] Jul 22 01:48:57.104177 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.104157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.106637 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.106569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 01:48:57.106814 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.106672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 01:48:57.106814 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.106685 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6zl2m\"" Jul 22 01:48:57.117672 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.117639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb"] Jul 22 01:48:57.120932 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.120901 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2njt4"] Jul 22 01:48:57.124184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.124159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.127621 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.127590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-62wtt\"" Jul 22 01:48:57.127621 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.127615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 01:48:57.127621 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.127592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 01:48:57.127982 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.127622 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 01:48:57.137785 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.137747 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2njt4"] Jul 22 01:48:57.144191 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.144152 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wndzc"] Jul 22 01:48:57.147798 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.147771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.150471 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.150443 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 01:48:57.150471 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.150462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 01:48:57.150664 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.150480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xs2gv\"" Jul 22 01:48:57.150664 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.150492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 01:48:57.229497 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-textfile\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-wtmp\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.229701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq78f\" (UniqueName: \"kubernetes.io/projected/f9af9114-19bf-4643-962a-85b2c77f137c-kube-api-access-xq78f\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqz54\" (UniqueName: \"kubernetes.io/projected/ffc22457-2096-477f-bae1-0d19171be12f-kube-api-access-jqz54\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgrmt\" (UniqueName: \"kubernetes.io/projected/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-kube-api-access-zgrmt\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9af9114-19bf-4643-962a-85b2c77f137c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-sys\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.229997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.230013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-root\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.230028 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.230027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-metrics-client-ca\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.230370 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.230066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.230370 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.230100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.331363 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.331568 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.331568 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.331568 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-wtmp\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.331568 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:57.331563 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq78f\" (UniqueName: \"kubernetes.io/projected/f9af9114-19bf-4643-962a-85b2c77f137c-kube-api-access-xq78f\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:48:57.331657 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls podName:ffc22457-2096-477f-bae1-0d19171be12f nodeName:}" failed. No retries permitted until 2026-07-22 01:48:57.831630889 +0000 UTC m=+75.512286438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls") pod "node-exporter-wndzc" (UID: "ffc22457-2096-477f-bae1-0d19171be12f") : secret "node-exporter-tls" not found Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-wtmp\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.331771 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqz54\" (UniqueName: \"kubernetes.io/projected/ffc22457-2096-477f-bae1-0d19171be12f-kube-api-access-jqz54\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgrmt\" (UniqueName: \"kubernetes.io/projected/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-kube-api-access-zgrmt\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9af9114-19bf-4643-962a-85b2c77f137c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-sys\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.331995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-root\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.332020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-metrics-client-ca\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.332052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.332090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.332157 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.332117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-textfile\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.332643 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.332275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-sys\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.333230 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.333230 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-textfile\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.333426 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffc22457-2096-477f-bae1-0d19171be12f-root\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.333426 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333295 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.333678 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9af9114-19bf-4643-962a-85b2c77f137c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.333968 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.333692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9af9114-19bf-4643-962a-85b2c77f137c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.334579 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.334527 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-metrics-client-ca\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.334850 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.334790 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.334850 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.334810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.335432 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.335408 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.335432 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.335425 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.336639 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.336614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9af9114-19bf-4643-962a-85b2c77f137c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.336730 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.336656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.340633 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.340612 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq78f\" (UniqueName: \"kubernetes.io/projected/f9af9114-19bf-4643-962a-85b2c77f137c-kube-api-access-xq78f\") pod \"kube-state-metrics-56c5594674-2njt4\" (UID: \"f9af9114-19bf-4643-962a-85b2c77f137c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.340878 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.340841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqz54\" (UniqueName: \"kubernetes.io/projected/ffc22457-2096-477f-bae1-0d19171be12f-kube-api-access-jqz54\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.341002 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.340986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgrmt\" (UniqueName: \"kubernetes.io/projected/8035ec9a-b0de-45be-9f4d-6dc6ffae1451-kube-api-access-zgrmt\") pod \"openshift-state-metrics-79f6958cdf-zcbtb\" (UID: \"8035ec9a-b0de-45be-9f4d-6dc6ffae1451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.366032 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.365946 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:57.370059 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.370031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:48:57.413680 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.413641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" Jul 22 01:48:57.433519 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.433484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" Jul 22 01:48:57.578406 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.578369 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb"] Jul 22 01:48:57.583314 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:57.583284 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8035ec9a_b0de_45be_9f4d_6dc6ffae1451.slice/crio-d5f0d010c2e11a580daf94dcd28b7c50c29c70eb5ff90203d3b246695d01a03b WatchSource:0}: Error finding container d5f0d010c2e11a580daf94dcd28b7c50c29c70eb5ff90203d3b246695d01a03b: Status 404 returned error can't find the container with id d5f0d010c2e11a580daf94dcd28b7c50c29c70eb5ff90203d3b246695d01a03b Jul 22 01:48:57.611728 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.611693 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2njt4"] Jul 22 01:48:57.614432 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:57.614398 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9af9114_19bf_4643_962a_85b2c77f137c.slice/crio-2244775e583c65cc7d3f6ac27509b6a1d01521f0353b9ca6bd63e1df5dcdf222 WatchSource:0}: Error finding container 2244775e583c65cc7d3f6ac27509b6a1d01521f0353b9ca6bd63e1df5dcdf222: Status 404 returned error can't find the container with id 2244775e583c65cc7d3f6ac27509b6a1d01521f0353b9ca6bd63e1df5dcdf222 Jul 22 01:48:57.837946 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.837910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:57.841424 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:57.840794 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffc22457-2096-477f-bae1-0d19171be12f-node-exporter-tls\") pod \"node-exporter-wndzc\" (UID: \"ffc22457-2096-477f-bae1-0d19171be12f\") " pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:58.058752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.058709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wndzc" Jul 22 01:48:58.070304 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:58.070271 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc22457_2096_477f_bae1_0d19171be12f.slice/crio-91472d37eede47b7328b81f4d8ea2a77318b764ac1305a24775a264e5812d35e WatchSource:0}: Error finding container 91472d37eede47b7328b81f4d8ea2a77318b764ac1305a24775a264e5812d35e: Status 404 returned error can't find the container with id 91472d37eede47b7328b81f4d8ea2a77318b764ac1305a24775a264e5812d35e Jul 22 01:48:58.175447 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.175409 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:48:58.180373 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.180343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.183094 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183058 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 01:48:58.183254 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183058 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 01:48:58.183254 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 01:48:58.183341 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7n6g5\"" Jul 22 01:48:58.183394 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 01:48:58.183990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 01:48:58.183990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 01:48:58.183990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 01:48:58.183990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 01:48:58.183990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.183812 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 01:48:58.194109 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.194078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:48:58.246308 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.246252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" event={"ID":"f9af9114-19bf-4643-962a-85b2c77f137c","Type":"ContainerStarted","Data":"2244775e583c65cc7d3f6ac27509b6a1d01521f0353b9ca6bd63e1df5dcdf222"} Jul 22 01:48:58.248745 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.248706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" event={"ID":"8035ec9a-b0de-45be-9f4d-6dc6ffae1451","Type":"ContainerStarted","Data":"7e961973185aa2f795ca815aa0d709f69f48efe26e16da8c27cdd316fbbcbb08"} Jul 22 01:48:58.248938 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.248784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" event={"ID":"8035ec9a-b0de-45be-9f4d-6dc6ffae1451","Type":"ContainerStarted","Data":"cf678635813123f953d17db0504cbf1812f4e413b0d77a5e96f45635a1fef556"} Jul 22 01:48:58.248938 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.248813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" event={"ID":"8035ec9a-b0de-45be-9f4d-6dc6ffae1451","Type":"ContainerStarted","Data":"d5f0d010c2e11a580daf94dcd28b7c50c29c70eb5ff90203d3b246695d01a03b"} Jul 22 01:48:58.253073 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.253029 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wndzc" event={"ID":"ffc22457-2096-477f-bae1-0d19171be12f","Type":"ContainerStarted","Data":"91472d37eede47b7328b81f4d8ea2a77318b764ac1305a24775a264e5812d35e"} Jul 22 01:48:58.342782 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpxs\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-kube-api-access-fxpxs\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.342971 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.342971 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-out\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.342971 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.342971 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343142 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.342996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343142 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343142 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343142 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-web-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.343600 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.343578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-web-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpxs\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-kube-api-access-fxpxs\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-out\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.444749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.446005 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.445852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.447017 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.446141 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.447017 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.446617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.449496 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.449395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.449927 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.449902 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-web-config\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.450080 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.450053 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.450280 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.450238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.451525 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.451489 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.451983 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.451957 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-out\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.452485 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.452461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.454446 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.454416 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpxs\" (UniqueName: \"kubernetes.io/projected/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-kube-api-access-fxpxs\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.454609 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.454577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.456706 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.456662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.490797 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.490758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 01:48:58.682392 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:58.682365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 01:48:58.795454 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:48:58.795416 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7f1da3_4f78_4fbd_84e2_d3c5bfc1ca00.slice/crio-b14ac96437de411fb7943da40eb68ee92013b7eab6271599cb4af563c6effcac WatchSource:0}: Error finding container b14ac96437de411fb7943da40eb68ee92013b7eab6271599cb4af563c6effcac: Status 404 returned error can't find the container with id b14ac96437de411fb7943da40eb68ee92013b7eab6271599cb4af563c6effcac Jul 22 01:48:59.259566 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:59.259527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"b14ac96437de411fb7943da40eb68ee92013b7eab6271599cb4af563c6effcac"} Jul 22 01:48:59.293124 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:59.293076 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:59.298019 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:59.297983 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:48:59.359397 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:48:59.356379 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:49:00.088754 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.088718 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8648784dcb-h5lww"] Jul 22 01:49:00.094277 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.094247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096740 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-57d2nual3d3od\"" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096786 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096798 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 22 01:49:00.096824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096801 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v8dsx\"" Jul 22 01:49:00.097230 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.096816 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 22 01:49:00.102824 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.102797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8648784dcb-h5lww"] Jul 22 01:49:00.263487 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbtk\" (UniqueName: \"kubernetes.io/projected/78a111ca-79a8-4b76-9b50-b2f68cec2e12-kube-api-access-wzbtk\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-grpc-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a111ca-79a8-4b76-9b50-b2f68cec2e12-metrics-client-ca\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.263990 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.263792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.265600 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.265573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" event={"ID":"f9af9114-19bf-4643-962a-85b2c77f137c","Type":"ContainerStarted","Data":"e14a66ae4de010dc200df778cbc3433d3fcf8c8500c4d4464e0eee75a32ab6f8"} Jul 22 01:49:00.265752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.265628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" event={"ID":"f9af9114-19bf-4643-962a-85b2c77f137c","Type":"ContainerStarted","Data":"0908bea82aadd8013c379abd91e9494d48c517bdf5e31bc914b96cd459d95877"} Jul 22 01:49:00.265752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.265646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" event={"ID":"f9af9114-19bf-4643-962a-85b2c77f137c","Type":"ContainerStarted","Data":"3a3eb96e9066c14020ad8512b1239beb52d9178ad429ae7a3f37d43bbadb0eb1"} Jul 22 01:49:00.267694 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.267668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" event={"ID":"8035ec9a-b0de-45be-9f4d-6dc6ffae1451","Type":"ContainerStarted","Data":"033d577c97489b381f1062e6f5a9abe1570a0ef2c5c71d8736904dcd177d1003"} Jul 22 01:49:00.269243 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.269219 2564 generic.go:356] "Generic (PLEG): container finished" podID="6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00" containerID="83daa8cbd406012ed2b137359c1a5f9aeb895827b0e81a508de9d90bcebb5b1c" exitCode=0 Jul 22 01:49:00.269352 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.269300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerDied","Data":"83daa8cbd406012ed2b137359c1a5f9aeb895827b0e81a508de9d90bcebb5b1c"} Jul 22 01:49:00.270926 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.270901 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffc22457-2096-477f-bae1-0d19171be12f" containerID="063b5e9215b485f66e96a736fd862988bf5dd21e0eb78e05256e5f1ccff6fded" exitCode=0 Jul 22 01:49:00.271439 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.271418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wndzc" event={"ID":"ffc22457-2096-477f-bae1-0d19171be12f","Type":"ContainerDied","Data":"063b5e9215b485f66e96a736fd862988bf5dd21e0eb78e05256e5f1ccff6fded"} Jul 22 01:49:00.287356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.287302 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2njt4" podStartSLOduration=1.508047838 podStartE2EDuration="3.287284215s" totalImagesPullingTime="1.779236377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:00.28598619 +0000 UTC m=+77.966641732" watchObservedRunningTime="2026-07-22 01:49:00.287284215 +0000 UTC m=+77.967939763" Jul 22 01:49:00.308047 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.307974 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-zcbtb" podStartSLOduration=1.6269869209999999 podStartE2EDuration="3.307951383s" totalImagesPullingTime="1.680964462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:00.307464636 +0000 UTC m=+77.988120185" watchObservedRunningTime="2026-07-22 01:49:00.307951383 +0000 UTC m=+77.988606934" Jul 22 01:49:00.365360 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.365326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbtk\" (UniqueName: \"kubernetes.io/projected/78a111ca-79a8-4b76-9b50-b2f68cec2e12-kube-api-access-wzbtk\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.365727 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.365698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-grpc-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.365831 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.365784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.365950 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.365931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.366057 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.366035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.366581 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.366146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.366581 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.366230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a111ca-79a8-4b76-9b50-b2f68cec2e12-metrics-client-ca\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.366581 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.366298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.369224 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.369183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.369349 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.369294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-grpc-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.371658 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.370483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.371658 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.370522 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.371658 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.371119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.376450 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.374490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbtk\" (UniqueName: \"kubernetes.io/projected/78a111ca-79a8-4b76-9b50-b2f68cec2e12-kube-api-access-wzbtk\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.376828 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.376775 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78a111ca-79a8-4b76-9b50-b2f68cec2e12-secret-thanos-querier-tls\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.377835 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.377810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a111ca-79a8-4b76-9b50-b2f68cec2e12-metrics-client-ca\") pod \"thanos-querier-8648784dcb-h5lww\" (UID: \"78a111ca-79a8-4b76-9b50-b2f68cec2e12\") " pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.405050 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.405003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:00.556969 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:00.556919 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8648784dcb-h5lww"] Jul 22 01:49:00.562282 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:49:00.562245 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a111ca_79a8_4b76_9b50_b2f68cec2e12.slice/crio-21a740dde8960a6216a87243eeac7a6135de030294a00870299aa56e094ab7d7 WatchSource:0}: Error finding container 21a740dde8960a6216a87243eeac7a6135de030294a00870299aa56e094ab7d7: Status 404 returned error can't find the container with id 21a740dde8960a6216a87243eeac7a6135de030294a00870299aa56e094ab7d7 Jul 22 01:49:01.281018 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.280897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wndzc" event={"ID":"ffc22457-2096-477f-bae1-0d19171be12f","Type":"ContainerStarted","Data":"101b14684e7ff8c6dbc1d4f8b7314a03b799e110b9b6b8b1f680a2cb1117af8b"} Jul 22 01:49:01.281018 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.280977 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wndzc" event={"ID":"ffc22457-2096-477f-bae1-0d19171be12f","Type":"ContainerStarted","Data":"d94ca08d4e9e01ba84b46dde6db6620641447bdc04c6cd1102d5c8e39067df8d"} Jul 22 01:49:01.283717 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.283688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"21a740dde8960a6216a87243eeac7a6135de030294a00870299aa56e094ab7d7"} Jul 22 01:49:01.301077 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.301011 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wndzc" podStartSLOduration=2.861213783 podStartE2EDuration="4.300985131s" totalImagesPullingTime="1.327142871s" totalInitContainerRuntime="112.628477ms" isStatefulPod=true podCreationTimestamp="2026-07-22 01:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:01.299517089 +0000 UTC m=+78.980172638" watchObservedRunningTime="2026-07-22 01:49:01.300985131 +0000 UTC m=+78.981640681" Jul 22 01:49:01.417551 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.417505 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8646447795-cgjl5"] Jul 22 01:49:01.421178 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.421147 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.423438 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423413 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gc64q\"" Jul 22 01:49:01.423438 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 01:49:01.423728 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423637 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 01:49:01.423728 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 01:49:01.423728 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423702 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dbtfc4j53fe3c\"" Jul 22 01:49:01.423975 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.423956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 01:49:01.432662 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.432589 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8646447795-cgjl5"] Jul 22 01:49:01.579126 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3157d79b-5cd9-4718-be33-e9b6361c6714-audit-log\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579126 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxcxz\" (UniqueName: \"kubernetes.io/projected/3157d79b-5cd9-4718-be33-e9b6361c6714-kube-api-access-zxcxz\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579527 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-metrics-server-audit-profiles\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579527 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-client-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579527 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-client-certs\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579527 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.579527 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.579271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-tls\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680693 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-metrics-server-audit-profiles\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680894 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-client-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680894 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-client-certs\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680894 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680894 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-tls\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.680894 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3157d79b-5cd9-4718-be33-e9b6361c6714-audit-log\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.681177 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.680913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxcxz\" (UniqueName: \"kubernetes.io/projected/3157d79b-5cd9-4718-be33-e9b6361c6714-kube-api-access-zxcxz\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.681616 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.681591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.681844 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.681821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3157d79b-5cd9-4718-be33-e9b6361c6714-metrics-server-audit-profiles\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.682126 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.682075 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3157d79b-5cd9-4718-be33-e9b6361c6714-audit-log\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.684941 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.684886 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-client-certs\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.685074 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.684988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-client-ca-bundle\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.685552 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.685527 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3157d79b-5cd9-4718-be33-e9b6361c6714-secret-metrics-server-tls\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.693748 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.693715 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxcxz\" (UniqueName: \"kubernetes.io/projected/3157d79b-5cd9-4718-be33-e9b6361c6714-kube-api-access-zxcxz\") pod \"metrics-server-8646447795-cgjl5\" (UID: \"3157d79b-5cd9-4718-be33-e9b6361c6714\") " pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.734909 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.734846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:01.902965 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.902930 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:49:01.914312 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.914244 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf"] Jul 22 01:49:01.914806 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.914715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:01.919793 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.919533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:49:01.919793 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.919669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf"] Jul 22 01:49:01.919793 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.919676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:01.922096 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.922050 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2bvpb\"" Jul 22 01:49:01.922361 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.922325 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 01:49:01.961458 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:01.961340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8646447795-cgjl5"] Jul 22 01:49:01.964365 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:49:01.964333 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3157d79b_5cd9_4718_be33_e9b6361c6714.slice/crio-85934838c192d1293c6641af6b4c304b350c11d182b6c3fd67812bf5c9aff046 WatchSource:0}: Error finding container 85934838c192d1293c6641af6b4c304b350c11d182b6c3fd67812bf5c9aff046: Status 404 returned error can't find the container with id 85934838c192d1293c6641af6b4c304b350c11d182b6c3fd67812bf5c9aff046 Jul 22 01:49:02.085164 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085164 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085164 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwg6\" (UniqueName: \"kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqk85\" (UniqueName: \"kubernetes.io/projected/501d4db3-5a9a-4efd-85d2-8b3710374315-kube-api-access-jqk85\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.085378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.085341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.186612 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqk85\" (UniqueName: \"kubernetes.io/projected/501d4db3-5a9a-4efd-85d2-8b3710374315-kube-api-access-jqk85\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.186815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.187186 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.187186 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.186899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwg6\" (UniqueName: \"kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.187544 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.187510 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.187652 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:49:02.187629 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 01:49:02.187784 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:49:02.187709 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert podName:501d4db3-5a9a-4efd-85d2-8b3710374315 nodeName:}" failed. No retries permitted until 2026-07-22 01:49:02.687689793 +0000 UTC m=+80.368345321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-hfvtf" (UID: "501d4db3-5a9a-4efd-85d2-8b3710374315") : secret "monitoring-plugin-cert" not found Jul 22 01:49:02.187784 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.187716 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.188610 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.188545 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.188610 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.188555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.190103 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.190082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.190356 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.190331 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.202311 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.202276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwg6\" (UniqueName: \"kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6\") pod \"console-764df6fb64-xvpql\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.202470 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.202365 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqk85\" (UniqueName: \"kubernetes.io/projected/501d4db3-5a9a-4efd-85d2-8b3710374315-kube-api-access-jqk85\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.235161 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.235098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:02.291540 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.291499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"9aa05b5668ffe17e2a90d863a157060884f548376e94521e482185970936a6fd"} Jul 22 01:49:02.291991 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.291664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"6fb36257f880f97071ae285e1f1507e48dca2ddab7203faf8b53c9cf06285734"} Jul 22 01:49:02.291991 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.291714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"cce4ea82fda133836dc7060651bd94a4c2b31edbe6003dcb4bcf1c5787e29f8d"} Jul 22 01:49:02.293059 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.293018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" event={"ID":"3157d79b-5cd9-4718-be33-e9b6361c6714","Type":"ContainerStarted","Data":"85934838c192d1293c6641af6b4c304b350c11d182b6c3fd67812bf5c9aff046"} Jul 22 01:49:02.692589 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.692556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.695517 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.695478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/501d4db3-5a9a-4efd-85d2-8b3710374315-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hfvtf\" (UID: \"501d4db3-5a9a-4efd-85d2-8b3710374315\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:02.823734 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.823657 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:49:02.831057 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:49:02.831025 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d33a8a_3687_4b93_a08d_6879f443ac50.slice/crio-7edaea283c3f0cfac27d076832229425e644d17902690c4ec53b43efc75c4b58 WatchSource:0}: Error finding container 7edaea283c3f0cfac27d076832229425e644d17902690c4ec53b43efc75c4b58: Status 404 returned error can't find the container with id 7edaea283c3f0cfac27d076832229425e644d17902690c4ec53b43efc75c4b58 Jul 22 01:49:02.851649 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:02.851624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:03.033226 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.033184 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf"] Jul 22 01:49:03.036924 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:49:03.036891 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501d4db3_5a9a_4efd_85d2_8b3710374315.slice/crio-5d6df37801990ca226616126bd7a948b3221c9fcab996d53a3bf2a375fbae693 WatchSource:0}: Error finding container 5d6df37801990ca226616126bd7a948b3221c9fcab996d53a3bf2a375fbae693: Status 404 returned error can't find the container with id 5d6df37801990ca226616126bd7a948b3221c9fcab996d53a3bf2a375fbae693 Jul 22 01:49:03.302591 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.302505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"09b9c7f01301c0095e5cd136c8c0242661a2593c94a4e84bcdef5f3a41b46474"} Jul 22 01:49:03.303077 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.302598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"b08ef402050bfe50df624c3f989350ba04cdc0676a71254f8ebaad238cca1f2c"} Jul 22 01:49:03.305184 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.305144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"bd1dc6b32c3c53bf6a1dc13475d4b24fe8129a1254e13cca6b57e017873e6246"} Jul 22 01:49:03.305334 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.305230 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"80ea9e6ab4d05ccd649cc920a409a83ebec49b5cc7d9908b3352f60f7899dc0c"} Jul 22 01:49:03.305334 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.305274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"c7dad6f23190334f5b297c32df793810f872343d05e4b0e23b4d26252cf516a1"} Jul 22 01:49:03.309367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.309336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764df6fb64-xvpql" event={"ID":"73d33a8a-3687-4b93-a08d-6879f443ac50","Type":"ContainerStarted","Data":"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958"} Jul 22 01:49:03.309506 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.309393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764df6fb64-xvpql" event={"ID":"73d33a8a-3687-4b93-a08d-6879f443ac50","Type":"ContainerStarted","Data":"7edaea283c3f0cfac27d076832229425e644d17902690c4ec53b43efc75c4b58"} Jul 22 01:49:03.310739 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.310674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" event={"ID":"501d4db3-5a9a-4efd-85d2-8b3710374315","Type":"ContainerStarted","Data":"5d6df37801990ca226616126bd7a948b3221c9fcab996d53a3bf2a375fbae693"} Jul 22 01:49:03.333501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.333439 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764df6fb64-xvpql" podStartSLOduration=2.333417287 podStartE2EDuration="2.333417287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:03.333232838 +0000 UTC m=+81.013888391" watchObservedRunningTime="2026-07-22 01:49:03.333417287 +0000 UTC m=+81.014072835" Jul 22 01:49:03.471303 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.470960 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 01:49:03.480300 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.480260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.483221 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.483190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 01:49:03.483518 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.483472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 01:49:03.483949 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.483685 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 01:49:03.483949 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.483915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dn4nk\"" Jul 22 01:49:03.484095 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 01:49:03.484148 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484096 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 01:49:03.484197 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 01:49:03.484240 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 01:49:03.484546 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484528 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 01:49:03.484706 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 01:49:03.484928 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484910 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 01:49:03.485003 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.484923 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 01:49:03.485078 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.485054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 01:49:03.485350 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.485328 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-154ufkb8h5n7m\"" Jul 22 01:49:03.487298 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.487182 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 01:49:03.491401 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.491351 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 01:49:03.495817 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.494188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 01:49:03.602942 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.602814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.602942 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.602892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.602951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.602978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603187 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603509 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603804 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603804 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.603804 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.603568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzs42\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-kube-api-access-zzs42\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.704763 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.704730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.704763 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.704773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.704806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.704911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.704952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705417 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705514 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzs42\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-kube-api-access-zzs42\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705514 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705514 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705674 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705967 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705967 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705967 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.705967 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.706149 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.706149 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.706031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.706149 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.705752 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.706633 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.706608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.709852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.708116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.709852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.708749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.709852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.708942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.709852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.709012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.711630 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.711394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.711630 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.711403 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.711630 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.711463 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.711630 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.711604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.713045 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.712987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.714600 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.714574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.714735 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.714661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.715046 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.715016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.716145 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.715227 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.716145 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.715622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-config\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.716145 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.716101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.716818 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.716785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.718983 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.718959 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzs42\" (UniqueName: \"kubernetes.io/projected/f26f959f-9eff-4343-95ab-d2ca30ad6cb2-kube-api-access-zzs42\") pod \"prometheus-k8s-0\" (UID: \"f26f959f-9eff-4343-95ab-d2ca30ad6cb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:03.796814 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:03.796766 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:04.273787 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.273753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 01:49:04.276520 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:49:04.276480 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26f959f_9eff_4343_95ab_d2ca30ad6cb2.slice/crio-8f2201240ce40a19823ce7973d2d3f0b9be686a1acea96fe5e147869b719f2ac WatchSource:0}: Error finding container 8f2201240ce40a19823ce7973d2d3f0b9be686a1acea96fe5e147869b719f2ac: Status 404 returned error can't find the container with id 8f2201240ce40a19823ce7973d2d3f0b9be686a1acea96fe5e147869b719f2ac Jul 22 01:49:04.324491 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.324453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00","Type":"ContainerStarted","Data":"1978fe5f8c4193bc747e137530cfbcf0ac242f2b7dd485eea1748fdfda66db29"} Jul 22 01:49:04.326987 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.326902 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"8f2201240ce40a19823ce7973d2d3f0b9be686a1acea96fe5e147869b719f2ac"} Jul 22 01:49:04.333730 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.333063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"a1a3a7e3cf267cab6bf6fff6f1db57fc943b23314f73048cd57abf7f30ca0a54"} Jul 22 01:49:04.333730 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.333201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"3386a7ac43723c57439076cd6b35e9b165c01af5bbaf8c68d34a947ea22e39ee"} Jul 22 01:49:04.337694 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.337658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" event={"ID":"3157d79b-5cd9-4718-be33-e9b6361c6714","Type":"ContainerStarted","Data":"d72c529d727052d789812498be87ba494ad7c1da974852d245ca4b75f80c316b"} Jul 22 01:49:04.354391 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.354333 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.111683506 podStartE2EDuration="6.35430853s" totalImagesPullingTime="4.226738362s" totalInitContainerRuntime="15.886662ms" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:04.352946235 +0000 UTC m=+82.033601784" watchObservedRunningTime="2026-07-22 01:49:04.35430853 +0000 UTC m=+82.034964082" Jul 22 01:49:04.385414 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:04.384876 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" podStartSLOduration=1.249225282 podStartE2EDuration="3.384744295s" totalImagesPullingTime="2.135519013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:04.383952194 +0000 UTC m=+82.064607745" watchObservedRunningTime="2026-07-22 01:49:04.384744295 +0000 UTC m=+82.065399845" Jul 22 01:49:05.344550 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.344456 2564 generic.go:356] "Generic (PLEG): container finished" podID="f26f959f-9eff-4343-95ab-d2ca30ad6cb2" containerID="5986c8f06ff2e265befbefcd2957d2eb3c8874ee64b6be066b88bd7cae5d08e8" exitCode=0 Jul 22 01:49:05.344987 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.344559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerDied","Data":"5986c8f06ff2e265befbefcd2957d2eb3c8874ee64b6be066b88bd7cae5d08e8"} Jul 22 01:49:05.348047 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.348012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" event={"ID":"78a111ca-79a8-4b76-9b50-b2f68cec2e12","Type":"ContainerStarted","Data":"60230b24cec1e1e3fcde95989947f8ba626af326ca5f3d32e7f1d8c6dd2ebc8c"} Jul 22 01:49:05.348312 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.348288 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:05.352449 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.350232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" event={"ID":"501d4db3-5a9a-4efd-85d2-8b3710374315","Type":"ContainerStarted","Data":"ca619893ef7223e025735068392055526a649acb0835aa00fed9549fc37c2309"} Jul 22 01:49:05.352449 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.351130 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:05.356450 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.356429 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" Jul 22 01:49:05.386989 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.386929 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hfvtf" podStartSLOduration=2.461161896 podStartE2EDuration="4.386909178s" totalImagesPullingTime="1.925747282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:05.386161452 +0000 UTC m=+83.066817001" watchObservedRunningTime="2026-07-22 01:49:05.386909178 +0000 UTC m=+83.067564728" Jul 22 01:49:05.413073 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:05.413013 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" podStartSLOduration=2.120471127 podStartE2EDuration="5.412993154s" totalImagesPullingTime="3.292522027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:05.411586038 +0000 UTC m=+83.092241589" watchObservedRunningTime="2026-07-22 01:49:05.412993154 +0000 UTC m=+83.093648701" Jul 22 01:49:09.375952 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.375904 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"7b37c58f0dcbf12f565fe1b247a3229d5c863bc2f56c81bf77276815a01f43af"} Jul 22 01:49:09.376367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.375996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"9c41b45fdefffe773881df30032a6139f5d5c771f435b9cb2939d60a49c50fe3"} Jul 22 01:49:09.376367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.376039 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"a9642e569441bbffd37388c3c04b8baef17f3398387747517c43d65cca7f1d87"} Jul 22 01:49:09.376367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.376080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"a39ab94ac0af757305348c35869c9dac0876a7247030c22bdca0370bf5d881bd"} Jul 22 01:49:09.376367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.376119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"b5f63a99d31187c90e149ea4c7a59e2cdc1ff33a52ea85206cfe2e031be0753d"} Jul 22 01:49:09.376367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.376156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f26f959f-9eff-4343-95ab-d2ca30ad6cb2","Type":"ContainerStarted","Data":"707382e491f7f32f671e1877f98085ab65ae06dfcd9daa1314a50f682517b3ee"} Jul 22 01:49:09.408477 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:09.408420 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.369559622 podStartE2EDuration="6.408402888s" totalImagesPullingTime="3.011348604s" totalInitContainerRuntime="27.494662ms" isStatefulPod=false podCreationTimestamp="2026-07-22 01:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:09.405533212 +0000 UTC m=+87.086188763" watchObservedRunningTime="2026-07-22 01:49:09.408402888 +0000 UTC m=+87.089058469" Jul 22 01:49:11.363719 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:11.363688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8648784dcb-h5lww" Jul 22 01:49:12.235991 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:12.235940 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:12.236218 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:12.236020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:12.242467 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:12.242428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:12.394938 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:12.394901 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:49:12.453724 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:12.453687 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:49:13.797469 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:13.797426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:49:21.735473 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:21.735418 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:21.735941 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:21.735505 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:24.381091 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:24.381016 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f8fd78c5-qbxhj" podUID="7c338022-5267-416a-8e75-0639005bed4a" containerName="console" containerID="cri-o://44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3" gracePeriod=15 Jul 22 01:49:25.175828 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.175795 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:49:25.317535 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317495 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.317720 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317579 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lckdt\" (UniqueName: \"kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.317720 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317641 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.317720 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317665 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.317720 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317698 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.317921 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.317778 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert\") pod \"7c338022-5267-416a-8e75-0639005bed4a\" (UID: \"7c338022-5267-416a-8e75-0639005bed4a\") " Jul 22 01:49:25.318130 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.318088 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:25.318270 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.318136 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:25.318270 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.318157 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config" (OuterVolumeSpecName: "console-config") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:25.320283 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.320253 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt" (OuterVolumeSpecName: "kube-api-access-lckdt") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "kube-api-access-lckdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:25.320283 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.320255 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:25.320410 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.320319 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c338022-5267-416a-8e75-0639005bed4a" (UID: "7c338022-5267-416a-8e75-0639005bed4a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:25.418886 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418835 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.419293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418900 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c338022-5267-416a-8e75-0639005bed4a-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.419293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418914 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lckdt\" (UniqueName: \"kubernetes.io/projected/7c338022-5267-416a-8e75-0639005bed4a-kube-api-access-lckdt\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.419293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418926 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.419293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418938 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.419293 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.418948 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c338022-5267-416a-8e75-0639005bed4a-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:25.449254 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.449220 2564 generic.go:356] "Generic (PLEG): container finished" podID="7c338022-5267-416a-8e75-0639005bed4a" containerID="44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3" exitCode=0 Jul 22 01:49:25.449400 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.449267 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f8fd78c5-qbxhj" Jul 22 01:49:25.449400 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.449281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8fd78c5-qbxhj" event={"ID":"7c338022-5267-416a-8e75-0639005bed4a","Type":"ContainerDied","Data":"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3"} Jul 22 01:49:25.449400 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.449323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f8fd78c5-qbxhj" event={"ID":"7c338022-5267-416a-8e75-0639005bed4a","Type":"ContainerDied","Data":"236a8fc64b58aa27e4100a01a7d2a9e4500572315a8a1fb2468ac946fad4e124"} Jul 22 01:49:25.449400 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.449341 2564 scope.go:117] "RemoveContainer" containerID="44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3" Jul 22 01:49:25.461175 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.461152 2564 scope.go:117] "RemoveContainer" containerID="44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3" Jul 22 01:49:25.461567 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:49:25.461527 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3\": container with ID starting with 44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3 not found: ID does not exist" containerID="44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3" Jul 22 01:49:25.461637 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.461574 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3"} err="failed to get container status \"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3\": rpc error: code = NotFound desc = could not find container \"44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3\": container with ID starting with 44e247b451dd9335d25bb2c6096df5c80167519f82dd42e38e3f38d2b25c02e3 not found: ID does not exist" Jul 22 01:49:25.470475 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.470444 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:49:25.476117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:25.476086 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f8fd78c5-qbxhj"] Jul 22 01:49:26.239875 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:26.239837 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nx9v7" Jul 22 01:49:26.754344 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:26.754308 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c338022-5267-416a-8e75-0639005bed4a" path="/var/lib/kubelet/pods/7c338022-5267-416a-8e75-0639005bed4a/volumes" Jul 22 01:49:37.476034 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.475989 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dbfff9b87-j7qjz" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerName="console" containerID="cri-o://45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495" gracePeriod=15 Jul 22 01:49:37.735249 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.735177 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:49:37.836493 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836446 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836493 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836500 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836732 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836559 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836732 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836615 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836732 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836645 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd2g4\" (UniqueName: \"kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836732 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836668 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.836732 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.836700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert\") pod \"1a1603b8-e079-4231-b3ad-ce7da9be8066\" (UID: \"1a1603b8-e079-4231-b3ad-ce7da9be8066\") " Jul 22 01:49:37.837042 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.837016 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config" (OuterVolumeSpecName: "console-config") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:37.837215 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.837187 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:37.837278 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.837235 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:37.837278 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.837245 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:37.839287 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.839259 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4" (OuterVolumeSpecName: "kube-api-access-fd2g4") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "kube-api-access-fd2g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:37.839287 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.839259 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:37.839422 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.839295 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a1603b8-e079-4231-b3ad-ce7da9be8066" (UID: "1a1603b8-e079-4231-b3ad-ce7da9be8066"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:37.937857 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937812 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.937857 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937847 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.937857 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937888 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd2g4\" (UniqueName: \"kubernetes.io/projected/1a1603b8-e079-4231-b3ad-ce7da9be8066-kube-api-access-fd2g4\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.937857 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937897 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.938150 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937907 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.938150 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937915 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:37.938150 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:37.937925 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1603b8-e079-4231-b3ad-ce7da9be8066-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:49:38.508702 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.508664 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerID="45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495" exitCode=0 Jul 22 01:49:38.509227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.508717 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbfff9b87-j7qjz" Jul 22 01:49:38.509227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.508733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbfff9b87-j7qjz" event={"ID":"1a1603b8-e079-4231-b3ad-ce7da9be8066","Type":"ContainerDied","Data":"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495"} Jul 22 01:49:38.509227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.508780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbfff9b87-j7qjz" event={"ID":"1a1603b8-e079-4231-b3ad-ce7da9be8066","Type":"ContainerDied","Data":"7dbabcbc120f45fafb58a130bd3e8be8bd1b276e57ab1d52df0bf5a0494621df"} Jul 22 01:49:38.509227 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.508802 2564 scope.go:117] "RemoveContainer" containerID="45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495" Jul 22 01:49:38.518349 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.518328 2564 scope.go:117] "RemoveContainer" containerID="45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495" Jul 22 01:49:38.518676 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:49:38.518656 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495\": container with ID starting with 45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495 not found: ID does not exist" containerID="45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495" Jul 22 01:49:38.518730 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.518686 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495"} err="failed to get container status \"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495\": rpc error: code = NotFound desc = could not find container \"45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495\": container with ID starting with 45693b6fe3d42445bc967edf746e23ad8ad5ba438a024889df04372bf75cb495 not found: ID does not exist" Jul 22 01:49:38.529916 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.529878 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:49:38.534997 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.534967 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dbfff9b87-j7qjz"] Jul 22 01:49:38.754705 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:38.754671 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" path="/var/lib/kubelet/pods/1a1603b8-e079-4231-b3ad-ce7da9be8066/volumes" Jul 22 01:49:41.740749 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:41.740712 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:49:41.744851 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:49:41.744821 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8646447795-cgjl5" Jul 22 01:50:03.796965 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:03.796912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:50:03.818208 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:03.818178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:50:04.649385 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:04.649355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 01:50:40.405888 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.405779 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406130 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerName="console" Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406143 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerName="console" Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406153 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c338022-5267-416a-8e75-0639005bed4a" containerName="console" Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406159 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c338022-5267-416a-8e75-0639005bed4a" containerName="console" Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406224 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c338022-5267-416a-8e75-0639005bed4a" containerName="console" Jul 22 01:50:40.406309 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.406232 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1603b8-e079-4231-b3ad-ce7da9be8066" containerName="console" Jul 22 01:50:40.409361 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.409340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.435274 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.435237 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:50:40.510500 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510692 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65pj\" (UniqueName: \"kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510944 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.510944 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.510794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.611772 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.611724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.611772 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.611771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65pj\" (UniqueName: \"kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.611911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612152 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612343 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612721 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.612927 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.613038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.612791 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.613038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.613023 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.614756 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.614719 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.614882 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.614788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.621056 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.621027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65pj\" (UniqueName: \"kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj\") pod \"console-8cdc57b78-x7cmc\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.725648 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.725546 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:40.890063 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:40.890032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:50:40.895159 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:50:40.895114 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dcd07d_5bb8_4b00_86df_3bfed84c2965.slice/crio-540692aebee869e962769764a4951b5a0e921ae5d2bae3f4017fe2d2f5f1f677 WatchSource:0}: Error finding container 540692aebee869e962769764a4951b5a0e921ae5d2bae3f4017fe2d2f5f1f677: Status 404 returned error can't find the container with id 540692aebee869e962769764a4951b5a0e921ae5d2bae3f4017fe2d2f5f1f677 Jul 22 01:50:41.791032 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:41.790992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdc57b78-x7cmc" event={"ID":"37dcd07d-5bb8-4b00-86df-3bfed84c2965","Type":"ContainerStarted","Data":"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77"} Jul 22 01:50:41.791427 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:41.791044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdc57b78-x7cmc" event={"ID":"37dcd07d-5bb8-4b00-86df-3bfed84c2965","Type":"ContainerStarted","Data":"540692aebee869e962769764a4951b5a0e921ae5d2bae3f4017fe2d2f5f1f677"} Jul 22 01:50:41.810243 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:41.810189 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8cdc57b78-x7cmc" podStartSLOduration=1.8101628779999999 podStartE2EDuration="1.810162878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:50:41.80860929 +0000 UTC m=+179.489264843" watchObservedRunningTime="2026-07-22 01:50:41.810162878 +0000 UTC m=+179.490818499" Jul 22 01:50:45.089649 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.089607 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:50:45.119365 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.119327 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7496c9cc4-p54vl"] Jul 22 01:50:45.123055 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.123033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.131373 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.131344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7496c9cc4-p54vl"] Jul 22 01:50:45.256380 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-trusted-ca-bundle\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256380 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-oauth-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256605 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256605 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmnf\" (UniqueName: \"kubernetes.io/projected/5ed86b88-925b-4ec6-9128-3cdc9d851eec-kube-api-access-drmnf\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256605 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256605 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-oauth-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.256727 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.256626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-service-ca\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357183 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-oauth-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357183 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357183 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmnf\" (UniqueName: \"kubernetes.io/projected/5ed86b88-925b-4ec6-9128-3cdc9d851eec-kube-api-access-drmnf\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357442 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357442 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-oauth-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357442 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-service-ca\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357442 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-trusted-ca-bundle\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357998 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-oauth-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.357998 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.357994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-service-ca\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.358239 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.358117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-trusted-ca-bundle\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.358239 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.358119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.359813 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.359792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-serving-cert\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.359939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.359895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed86b88-925b-4ec6-9128-3cdc9d851eec-console-oauth-config\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.364926 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.364900 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmnf\" (UniqueName: \"kubernetes.io/projected/5ed86b88-925b-4ec6-9128-3cdc9d851eec-kube-api-access-drmnf\") pod \"console-7496c9cc4-p54vl\" (UID: \"5ed86b88-925b-4ec6-9128-3cdc9d851eec\") " pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.433753 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.433706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:45.586501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.586458 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7496c9cc4-p54vl"] Jul 22 01:50:45.589923 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:50:45.589885 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed86b88_925b_4ec6_9128_3cdc9d851eec.slice/crio-7b2c39d54b2d1a321693379997b8a680601c56d00490eab1449999cd05af4f68 WatchSource:0}: Error finding container 7b2c39d54b2d1a321693379997b8a680601c56d00490eab1449999cd05af4f68: Status 404 returned error can't find the container with id 7b2c39d54b2d1a321693379997b8a680601c56d00490eab1449999cd05af4f68 Jul 22 01:50:45.810923 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.810856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7496c9cc4-p54vl" event={"ID":"5ed86b88-925b-4ec6-9128-3cdc9d851eec","Type":"ContainerStarted","Data":"ef84dc4ad6e8c5e3b25e0f74d3d7a80c39d3c00d65389f5ac7392c796f1f8ee6"} Jul 22 01:50:45.811104 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.810945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7496c9cc4-p54vl" event={"ID":"5ed86b88-925b-4ec6-9128-3cdc9d851eec","Type":"ContainerStarted","Data":"7b2c39d54b2d1a321693379997b8a680601c56d00490eab1449999cd05af4f68"} Jul 22 01:50:45.827852 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:45.827790 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7496c9cc4-p54vl" podStartSLOduration=0.827768431 podStartE2EDuration="827.768431ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:50:45.826204154 +0000 UTC m=+183.506859700" watchObservedRunningTime="2026-07-22 01:50:45.827768431 +0000 UTC m=+183.508423980" Jul 22 01:50:50.725910 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:50.725844 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:50:55.434299 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:55.434248 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:55.434299 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:55.434312 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:55.439122 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:55.439093 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:55.854596 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:55.854509 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7496c9cc4-p54vl" Jul 22 01:50:55.902006 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:50:55.901964 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:51:10.110994 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.110918 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8cdc57b78-x7cmc" podUID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" containerName="console" containerID="cri-o://3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77" gracePeriod=15 Jul 22 01:51:10.363598 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.363527 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:51:10.403176 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403139 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403207 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n65pj\" (UniqueName: \"kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403264 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403306 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403387 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403333 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403625 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca\") pod \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\" (UID: \"37dcd07d-5bb8-4b00-86df-3bfed84c2965\") " Jul 22 01:51:10.403850 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.403731 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:10.404071 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.404019 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config" (OuterVolumeSpecName: "console-config") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:10.404172 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.404067 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:10.404235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.404121 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca" (OuterVolumeSpecName: "service-ca") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:10.405829 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.405792 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:51:10.405829 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.405808 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:51:10.405991 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.405829 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj" (OuterVolumeSpecName: "kube-api-access-n65pj") pod "37dcd07d-5bb8-4b00-86df-3bfed84c2965" (UID: "37dcd07d-5bb8-4b00-86df-3bfed84c2965"). InnerVolumeSpecName "kube-api-access-n65pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:10.505117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505073 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505109 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n65pj\" (UniqueName: \"kubernetes.io/projected/37dcd07d-5bb8-4b00-86df-3bfed84c2965-kube-api-access-n65pj\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505118 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505127 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505117 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505135 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505428 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505144 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.505428 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.505153 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37dcd07d-5bb8-4b00-86df-3bfed84c2965-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:10.913827 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.913792 2564 generic.go:356] "Generic (PLEG): container finished" podID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" containerID="3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77" exitCode=0 Jul 22 01:51:10.914009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.913836 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdc57b78-x7cmc" Jul 22 01:51:10.914009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.913836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdc57b78-x7cmc" event={"ID":"37dcd07d-5bb8-4b00-86df-3bfed84c2965","Type":"ContainerDied","Data":"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77"} Jul 22 01:51:10.914009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.913969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdc57b78-x7cmc" event={"ID":"37dcd07d-5bb8-4b00-86df-3bfed84c2965","Type":"ContainerDied","Data":"540692aebee869e962769764a4951b5a0e921ae5d2bae3f4017fe2d2f5f1f677"} Jul 22 01:51:10.914009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.913995 2564 scope.go:117] "RemoveContainer" containerID="3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77" Jul 22 01:51:10.923001 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.922979 2564 scope.go:117] "RemoveContainer" containerID="3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77" Jul 22 01:51:10.923347 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:51:10.923322 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77\": container with ID starting with 3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77 not found: ID does not exist" containerID="3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77" Jul 22 01:51:10.923453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.923353 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77"} err="failed to get container status \"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77\": rpc error: code = NotFound desc = could not find container \"3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77\": container with ID starting with 3ef7051264e496a5bc9fd8656f555e7b4d0457fae58289358ce6383206befb77 not found: ID does not exist" Jul 22 01:51:10.929969 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.929937 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:51:10.933289 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:10.933262 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8cdc57b78-x7cmc"] Jul 22 01:51:12.754040 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:12.754006 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" path="/var/lib/kubelet/pods/37dcd07d-5bb8-4b00-86df-3bfed84c2965/volumes" Jul 22 01:51:20.924808 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:20.924735 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-764df6fb64-xvpql" podUID="73d33a8a-3687-4b93-a08d-6879f443ac50" containerName="console" containerID="cri-o://681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958" gracePeriod=15 Jul 22 01:51:21.173934 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.173896 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:51:21.306931 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.306794 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.306931 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.306843 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.306931 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.306912 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.307235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.306947 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkwg6\" (UniqueName: \"kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.307235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.306981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.307235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307139 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.307235 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307231 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle\") pod \"73d33a8a-3687-4b93-a08d-6879f443ac50\" (UID: \"73d33a8a-3687-4b93-a08d-6879f443ac50\") " Jul 22 01:51:21.307441 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307294 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config" (OuterVolumeSpecName: "console-config") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:21.307441 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307422 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:21.307578 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307549 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca" (OuterVolumeSpecName: "service-ca") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:21.307702 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307658 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:51:21.307831 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307685 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-console-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.307831 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307752 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-oauth-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.307954 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.307842 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-service-ca\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.309493 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.309467 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:51:21.309493 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.309486 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:51:21.309623 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.309488 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6" (OuterVolumeSpecName: "kube-api-access-dkwg6") pod "73d33a8a-3687-4b93-a08d-6879f443ac50" (UID: "73d33a8a-3687-4b93-a08d-6879f443ac50"). InnerVolumeSpecName "kube-api-access-dkwg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:51:21.408789 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.408744 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-oauth-config\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.408789 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.408782 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73d33a8a-3687-4b93-a08d-6879f443ac50-trusted-ca-bundle\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.408789 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.408800 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73d33a8a-3687-4b93-a08d-6879f443ac50-console-serving-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.409074 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.408810 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkwg6\" (UniqueName: \"kubernetes.io/projected/73d33a8a-3687-4b93-a08d-6879f443ac50-kube-api-access-dkwg6\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 01:51:21.964375 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.964333 2564 generic.go:356] "Generic (PLEG): container finished" podID="73d33a8a-3687-4b93-a08d-6879f443ac50" containerID="681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958" exitCode=0 Jul 22 01:51:21.964916 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.964392 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764df6fb64-xvpql" Jul 22 01:51:21.964916 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.964406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764df6fb64-xvpql" event={"ID":"73d33a8a-3687-4b93-a08d-6879f443ac50","Type":"ContainerDied","Data":"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958"} Jul 22 01:51:21.964916 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.964465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764df6fb64-xvpql" event={"ID":"73d33a8a-3687-4b93-a08d-6879f443ac50","Type":"ContainerDied","Data":"7edaea283c3f0cfac27d076832229425e644d17902690c4ec53b43efc75c4b58"} Jul 22 01:51:21.964916 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.964487 2564 scope.go:117] "RemoveContainer" containerID="681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958" Jul 22 01:51:21.974348 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.974329 2564 scope.go:117] "RemoveContainer" containerID="681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958" Jul 22 01:51:21.974659 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:51:21.974639 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958\": container with ID starting with 681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958 not found: ID does not exist" containerID="681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958" Jul 22 01:51:21.974759 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.974666 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958"} err="failed to get container status \"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958\": rpc error: code = NotFound desc = could not find container \"681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958\": container with ID starting with 681dfa7cc1e056d895b33da4836c4ec1be838c020d8fc8ccf2d2c0bb6b15a958 not found: ID does not exist" Jul 22 01:51:21.986592 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.986552 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:51:21.988103 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:21.988077 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764df6fb64-xvpql"] Jul 22 01:51:22.754816 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:51:22.754781 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73d33a8a-3687-4b93-a08d-6879f443ac50" path="/var/lib/kubelet/pods/73d33a8a-3687-4b93-a08d-6879f443ac50/volumes" Jul 22 01:52:23.642939 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.642895 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zgms"] Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643226 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" containerName="console" Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643237 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" containerName="console" Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643257 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73d33a8a-3687-4b93-a08d-6879f443ac50" containerName="console" Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643263 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73d33a8a-3687-4b93-a08d-6879f443ac50" containerName="console" Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643313 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73d33a8a-3687-4b93-a08d-6879f443ac50" containerName="console" Jul 22 01:52:23.643374 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.643324 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37dcd07d-5bb8-4b00-86df-3bfed84c2965" containerName="console" Jul 22 01:52:23.646435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.646410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.648957 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.648935 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 01:52:23.649097 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.648936 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 01:52:23.649097 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.648972 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tw5z9\"" Jul 22 01:52:23.655566 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.655538 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zgms"] Jul 22 01:52:23.680932 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.680855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.681137 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.680957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-258rn\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-kube-api-access-258rn\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.782274 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.782225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.782462 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.782284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-258rn\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-kube-api-access-258rn\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.790701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.790664 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.790856 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.790799 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-258rn\" (UniqueName: \"kubernetes.io/projected/129b3d43-be7e-43fd-88d7-9af658d4c793-kube-api-access-258rn\") pod \"cert-manager-cainjector-559cdd8c87-5zgms\" (UID: \"129b3d43-be7e-43fd-88d7-9af658d4c793\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:23.970401 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:23.970303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" Jul 22 01:52:24.111453 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:24.111429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5zgms"] Jul 22 01:52:24.114069 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:52:24.114043 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod129b3d43_be7e_43fd_88d7_9af658d4c793.slice/crio-f717b61c87147c15d1c4b39b14ef88aa16b7df4a60eb3f394616330537deaf19 WatchSource:0}: Error finding container f717b61c87147c15d1c4b39b14ef88aa16b7df4a60eb3f394616330537deaf19: Status 404 returned error can't find the container with id f717b61c87147c15d1c4b39b14ef88aa16b7df4a60eb3f394616330537deaf19 Jul 22 01:52:24.226079 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:24.225984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" event={"ID":"129b3d43-be7e-43fd-88d7-9af658d4c793","Type":"ContainerStarted","Data":"f717b61c87147c15d1c4b39b14ef88aa16b7df4a60eb3f394616330537deaf19"} Jul 22 01:52:27.243219 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:27.243184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" event={"ID":"129b3d43-be7e-43fd-88d7-9af658d4c793","Type":"ContainerStarted","Data":"a5850a555815a38c84a24af4759fcb0cd9f2266d4df9880de94a6d2e961808de"} Jul 22 01:52:27.280239 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:27.280109 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5zgms" podStartSLOduration=1.383115104 podStartE2EDuration="4.280082777s" totalImagesPullingTime="2.896967673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:27.279560851 +0000 UTC m=+284.960216417" watchObservedRunningTime="2026-07-22 01:52:27.280082777 +0000 UTC m=+284.960738329" Jul 22 01:52:41.873004 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.872959 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6gj9"] Jul 22 01:52:41.876721 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.876699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:41.879169 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.879146 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b8m8k\"" Jul 22 01:52:41.884561 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.884146 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6gj9"] Jul 22 01:52:41.952229 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.952178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdx5l\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-kube-api-access-qdx5l\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:41.952436 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:41.952263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.053577 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.053535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdx5l\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-kube-api-access-qdx5l\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.053749 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.053588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.061761 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.061727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-bound-sa-token\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.061936 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.061856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdx5l\" (UniqueName: \"kubernetes.io/projected/b8369689-680e-4143-b3e8-ada36556f0c7-kube-api-access-qdx5l\") pod \"cert-manager-55b4d954d5-n6gj9\" (UID: \"b8369689-680e-4143-b3e8-ada36556f0c7\") " pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.187471 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.187426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n6gj9" Jul 22 01:52:42.332364 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.332152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n6gj9"] Jul 22 01:52:42.335284 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:52:42.335246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8369689_680e_4143_b3e8_ada36556f0c7.slice/crio-b0e6221906e16ea316175cc84f2a4024b851f431093b2d435ccacb7e03d5a954 WatchSource:0}: Error finding container b0e6221906e16ea316175cc84f2a4024b851f431093b2d435ccacb7e03d5a954: Status 404 returned error can't find the container with id b0e6221906e16ea316175cc84f2a4024b851f431093b2d435ccacb7e03d5a954 Jul 22 01:52:42.644698 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:42.644670 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 01:52:43.313465 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:43.313423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n6gj9" event={"ID":"b8369689-680e-4143-b3e8-ada36556f0c7","Type":"ContainerStarted","Data":"2ab8ffcd07918f6072a2dbfbbb9ea3bdb536f430f38ad99e465dccea8223bee9"} Jul 22 01:52:43.313465 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:43.313472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n6gj9" event={"ID":"b8369689-680e-4143-b3e8-ada36556f0c7","Type":"ContainerStarted","Data":"b0e6221906e16ea316175cc84f2a4024b851f431093b2d435ccacb7e03d5a954"} Jul 22 01:52:43.328506 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:52:43.328444 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-n6gj9" podStartSLOduration=2.328425515 podStartE2EDuration="2.328425515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:43.327640028 +0000 UTC m=+301.008295582" watchObservedRunningTime="2026-07-22 01:52:43.328425515 +0000 UTC m=+301.009081064" Jul 22 01:53:04.747291 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.747247 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx"] Jul 22 01:53:04.750770 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.750740 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.753373 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.753348 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 01:53:04.753547 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.753505 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 01:53:04.753962 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.753943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 01:53:04.754047 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.754031 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 01:53:04.754103 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.754075 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5gsh8\"" Jul 22 01:53:04.765909 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.765846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.766089 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.765941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.766089 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.765977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.766089 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.766006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.766195 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.766100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxkr\" (UniqueName: \"kubernetes.io/projected/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-kube-api-access-6gxkr\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.767882 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.767829 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx"] Jul 22 01:53:04.866489 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.866434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxkr\" (UniqueName: \"kubernetes.io/projected/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-kube-api-access-6gxkr\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.866489 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.866490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.866752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.866533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.866752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.866551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.866752 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.866570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.867134 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.867112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.869377 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.869347 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.869633 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.869611 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.869709 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.869611 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:04.878492 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:04.878454 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxkr\" (UniqueName: \"kubernetes.io/projected/a14cdb74-93c6-49ba-8cc2-1c733e0ad22f-kube-api-access-6gxkr\") pod \"opendatahub-operator-controller-manager-76db4bc599-bl8wx\" (UID: \"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:05.065908 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:05.065749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:05.232966 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:05.232811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx"] Jul 22 01:53:05.235855 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:53:05.235814 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14cdb74_93c6_49ba_8cc2_1c733e0ad22f.slice/crio-cd61e4f0c353deb4eabdd50609268f3207d75de73b6dc380ecd33ff8ee7d23b0 WatchSource:0}: Error finding container cd61e4f0c353deb4eabdd50609268f3207d75de73b6dc380ecd33ff8ee7d23b0: Status 404 returned error can't find the container with id cd61e4f0c353deb4eabdd50609268f3207d75de73b6dc380ecd33ff8ee7d23b0 Jul 22 01:53:05.238457 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:05.238436 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:53:05.406806 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:05.406759 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" event={"ID":"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f","Type":"ContainerStarted","Data":"cd61e4f0c353deb4eabdd50609268f3207d75de73b6dc380ecd33ff8ee7d23b0"} Jul 22 01:53:08.424369 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:08.424322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" event={"ID":"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f","Type":"ContainerStarted","Data":"8dc2e004d2fe4a17d5763cb56fce641db4b7cc35c573c6eefb48a57ea4a95bf7"} Jul 22 01:53:09.430949 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:09.430857 2564 generic.go:356] "Generic (PLEG): container finished" podID="a14cdb74-93c6-49ba-8cc2-1c733e0ad22f" containerID="8dc2e004d2fe4a17d5763cb56fce641db4b7cc35c573c6eefb48a57ea4a95bf7" exitCode=0 Jul 22 01:53:09.431365 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:09.430898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" event={"ID":"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f","Type":"ContainerDied","Data":"8dc2e004d2fe4a17d5763cb56fce641db4b7cc35c573c6eefb48a57ea4a95bf7"} Jul 22 01:53:10.439838 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:10.439796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" event={"ID":"a14cdb74-93c6-49ba-8cc2-1c733e0ad22f","Type":"ContainerStarted","Data":"728cc4fa42b0a7d8c959b05623153a065b29e23ad6055c45e2813c98203c5cb9"} Jul 22 01:53:10.464300 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:10.464237 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" podStartSLOduration=2.050171857 podStartE2EDuration="6.464212547s" totalImagesPullingTime="3.298735436s" totalInitContainerRuntime="1.115305254s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:10.46126979 +0000 UTC m=+328.141925351" watchObservedRunningTime="2026-07-22 01:53:10.464212547 +0000 UTC m=+328.144868097" Jul 22 01:53:11.444426 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:11.444386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:22.450836 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:22.450801 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-bl8wx" Jul 22 01:53:24.429597 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.429556 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v"] Jul 22 01:53:24.438817 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.438790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.443219 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.443185 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 01:53:24.443398 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.443237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jvxbk\"" Jul 22 01:53:24.443497 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.443436 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 01:53:24.444697 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.444676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 01:53:24.445342 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.445323 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:53:24.445694 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.445631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 01:53:24.446180 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.446154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v"] Jul 22 01:53:24.556907 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.556849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.557099 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.556918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mf6n\" (UniqueName: \"kubernetes.io/projected/3971c2fb-97b4-48f8-abab-164c88709d00-kube-api-access-2mf6n\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.557099 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.556971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3971c2fb-97b4-48f8-abab-164c88709d00-manager-config\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.557099 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.557077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.658580 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.658538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3971c2fb-97b4-48f8-abab-164c88709d00-manager-config\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.658821 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.658626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.658821 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.658680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.658821 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.658703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mf6n\" (UniqueName: \"kubernetes.io/projected/3971c2fb-97b4-48f8-abab-164c88709d00-kube-api-access-2mf6n\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.659394 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.659364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3971c2fb-97b4-48f8-abab-164c88709d00-manager-config\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.661482 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.661460 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.661552 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.661484 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3971c2fb-97b4-48f8-abab-164c88709d00-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.666979 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.666950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mf6n\" (UniqueName: \"kubernetes.io/projected/3971c2fb-97b4-48f8-abab-164c88709d00-kube-api-access-2mf6n\") pod \"lws-controller-manager-54d5765bf5-qfk9v\" (UID: \"3971c2fb-97b4-48f8-abab-164c88709d00\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.752188 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.752076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:24.915910 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.915856 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm"] Jul 22 01:53:24.921325 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.921300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:24.925238 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.925207 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f8xnk\"" Jul 22 01:53:24.925428 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.925263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 01:53:24.925428 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.925220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 01:53:24.925562 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.925543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 01:53:24.925935 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.925916 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 01:53:24.926799 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.926775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v"] Jul 22 01:53:24.929359 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:53:24.929329 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3971c2fb_97b4_48f8_abab_164c88709d00.slice/crio-63d1a344826289c0d0d97380fd038c947e6a893e3810932e4c687ffd38ab89ac WatchSource:0}: Error finding container 63d1a344826289c0d0d97380fd038c947e6a893e3810932e4c687ffd38ab89ac: Status 404 returned error can't find the container with id 63d1a344826289c0d0d97380fd038c947e6a893e3810932e4c687ffd38ab89ac Jul 22 01:53:24.936573 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:24.936544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm"] Jul 22 01:53:25.062192 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.062091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tls-certs\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.062367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.062242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvb5r\" (UniqueName: \"kubernetes.io/projected/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-kube-api-access-xvb5r\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.062367 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.062285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tmp\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.163751 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.163715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvb5r\" (UniqueName: \"kubernetes.io/projected/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-kube-api-access-xvb5r\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.163989 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.163779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tmp\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.163989 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.163819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tls-certs\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.166584 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.166555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tls-certs\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.166710 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.166659 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-tmp\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.172720 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.172685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvb5r\" (UniqueName: \"kubernetes.io/projected/468e79a1-1ddb-4d7d-9d78-9d84a8dabe68-kube-api-access-xvb5r\") pod \"kube-auth-proxy-75f64fb6dd-ws2mm\" (UID: \"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68\") " pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.247129 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.247089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" Jul 22 01:53:25.424420 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.424389 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm"] Jul 22 01:53:25.427215 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:53:25.427178 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468e79a1_1ddb_4d7d_9d78_9d84a8dabe68.slice/crio-455c4e4bab6da1887f9c1d484b45b7a45de8d0751e074155fc050b3451abdee9 WatchSource:0}: Error finding container 455c4e4bab6da1887f9c1d484b45b7a45de8d0751e074155fc050b3451abdee9: Status 404 returned error can't find the container with id 455c4e4bab6da1887f9c1d484b45b7a45de8d0751e074155fc050b3451abdee9 Jul 22 01:53:25.513132 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.513073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" event={"ID":"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68","Type":"ContainerStarted","Data":"455c4e4bab6da1887f9c1d484b45b7a45de8d0751e074155fc050b3451abdee9"} Jul 22 01:53:25.514577 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:25.514542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" event={"ID":"3971c2fb-97b4-48f8-abab-164c88709d00","Type":"ContainerStarted","Data":"63d1a344826289c0d0d97380fd038c947e6a893e3810932e4c687ffd38ab89ac"} Jul 22 01:53:29.542012 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:29.541964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" event={"ID":"3971c2fb-97b4-48f8-abab-164c88709d00","Type":"ContainerStarted","Data":"3416b9ba9cde5e89befbf48fae7707ed3a452cb20ceafbe039160365fd3feb96"} Jul 22 01:53:29.542492 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:29.542033 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:53:29.543708 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:29.543679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" event={"ID":"468e79a1-1ddb-4d7d-9d78-9d84a8dabe68","Type":"ContainerStarted","Data":"bf3f2a50b05ad1c5231fe265f8367629405d8fed6f1fb93edfedb4169984bcc2"} Jul 22 01:53:29.560357 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:29.560303 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" podStartSLOduration=1.528403828 podStartE2EDuration="5.560286176s" totalImagesPullingTime="4.031882348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:29.55852096 +0000 UTC m=+347.239176511" watchObservedRunningTime="2026-07-22 01:53:29.560286176 +0000 UTC m=+347.240941726" Jul 22 01:53:29.576216 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:29.576153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75f64fb6dd-ws2mm" podStartSLOduration=2.039346521 podStartE2EDuration="5.576134041s" totalImagesPullingTime="3.53678752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:29.574750713 +0000 UTC m=+347.255406242" watchObservedRunningTime="2026-07-22 01:53:29.576134041 +0000 UTC m=+347.256789592" Jul 22 01:53:40.551604 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:53:40.551525 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-qfk9v" Jul 22 01:55:02.949561 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.949462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4"] Jul 22 01:55:02.953085 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.953058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:02.955821 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.955782 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 01:55:02.956093 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.956037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zd2t\"" Jul 22 01:55:02.956292 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.956266 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 22 01:55:02.956467 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.956443 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 01:55:02.956539 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.956479 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 22 01:55:02.966850 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.966813 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4"] Jul 22 01:55:02.983087 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.983021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:02.983286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.983138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7v79\" (UniqueName: \"kubernetes.io/projected/1d75a4a1-fef4-4aef-b149-480fff15b670-kube-api-access-r7v79\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:02.983286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:02.983183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d75a4a1-fef4-4aef-b149-480fff15b670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.083999 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.083949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7v79\" (UniqueName: \"kubernetes.io/projected/1d75a4a1-fef4-4aef-b149-480fff15b670-kube-api-access-r7v79\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.084241 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.084018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d75a4a1-fef4-4aef-b149-480fff15b670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.084241 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.084112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.084241 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:55:03.084216 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 22 01:55:03.084401 ip-10-0-132-26 kubenswrapper[2564]: E0722 01:55:03.084294 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert podName:1d75a4a1-fef4-4aef-b149-480fff15b670 nodeName:}" failed. No retries permitted until 2026-07-22 01:55:03.584272778 +0000 UTC m=+441.264928307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-xhrg4" (UID: "1d75a4a1-fef4-4aef-b149-480fff15b670") : secret "plugin-serving-cert" not found Jul 22 01:55:03.084795 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.084772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d75a4a1-fef4-4aef-b149-480fff15b670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.092900 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.092844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7v79\" (UniqueName: \"kubernetes.io/projected/1d75a4a1-fef4-4aef-b149-480fff15b670-kube-api-access-r7v79\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.588763 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.588727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.591391 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.591356 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d75a4a1-fef4-4aef-b149-480fff15b670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xhrg4\" (UID: \"1d75a4a1-fef4-4aef-b149-480fff15b670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:03.868712 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:03.868594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" Jul 22 01:55:04.023162 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:04.023026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4"] Jul 22 01:55:04.026017 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:55:04.025983 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d75a4a1_fef4_4aef_b149_480fff15b670.slice/crio-74d34e7e6e810c3a331cd682d03fa0544425e1b10f2773f346c9756e1aa4bf15 WatchSource:0}: Error finding container 74d34e7e6e810c3a331cd682d03fa0544425e1b10f2773f346c9756e1aa4bf15: Status 404 returned error can't find the container with id 74d34e7e6e810c3a331cd682d03fa0544425e1b10f2773f346c9756e1aa4bf15 Jul 22 01:55:05.011326 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:05.011289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" event={"ID":"1d75a4a1-fef4-4aef-b149-480fff15b670","Type":"ContainerStarted","Data":"74d34e7e6e810c3a331cd682d03fa0544425e1b10f2773f346c9756e1aa4bf15"} Jul 22 01:55:28.156364 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:28.156316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" event={"ID":"1d75a4a1-fef4-4aef-b149-480fff15b670","Type":"ContainerStarted","Data":"d90c2abf8693cb09a3944bdeee75832c82e588150b23fb39417cc9e345ca9db5"} Jul 22 01:55:28.172525 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:28.172472 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xhrg4" podStartSLOduration=2.264820487 podStartE2EDuration="26.172454452s" totalImagesPullingTime="23.907633965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:55:28.171039854 +0000 UTC m=+465.851695401" watchObservedRunningTime="2026-07-22 01:55:28.172454452 +0000 UTC m=+465.853110002" Jul 22 01:55:42.169308 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.169272 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw"] Jul 22 01:55:42.172289 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.172266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.174537 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.174512 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 01:55:42.174675 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.174577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6trm8\"" Jul 22 01:55:42.183711 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.183679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw"] Jul 22 01:55:42.286774 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13627a72-d395-4625-820a-8aae268245ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287009 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.286991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9kv\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-kube-api-access-mx9kv\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287181 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.287019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287181 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.287066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.287181 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.287092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13627a72-d395-4625-820a-8aae268245ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388029 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.387983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388029 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9kv\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-kube-api-access-mx9kv\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13627a72-d395-4625-820a-8aae268245ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13627a72-d395-4625-820a-8aae268245ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388304 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388646 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388477 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388704 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.388786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388751 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.389010 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.388790 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.389476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.389448 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13627a72-d395-4625-820a-8aae268245ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.390849 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.390826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13627a72-d395-4625-820a-8aae268245ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.391000 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.390982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13627a72-d395-4625-820a-8aae268245ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.396312 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.396283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9kv\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-kube-api-access-mx9kv\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.396554 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.396530 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13627a72-d395-4625-820a-8aae268245ce-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-68nmw\" (UID: \"13627a72-d395-4625-820a-8aae268245ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.484611 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.484511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:42.640122 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:42.638546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw"] Jul 22 01:55:42.645817 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:55:42.645784 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13627a72_d395_4625_820a_8aae268245ce.slice/crio-9a13a4af273bdaf2062168e332d7f6c93318ac9c6e64018ef2c9619af86eab74 WatchSource:0}: Error finding container 9a13a4af273bdaf2062168e332d7f6c93318ac9c6e64018ef2c9619af86eab74: Status 404 returned error can't find the container with id 9a13a4af273bdaf2062168e332d7f6c93318ac9c6e64018ef2c9619af86eab74 Jul 22 01:55:43.235982 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:43.235941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" event={"ID":"13627a72-d395-4625-820a-8aae268245ce","Type":"ContainerStarted","Data":"9a13a4af273bdaf2062168e332d7f6c93318ac9c6e64018ef2c9619af86eab74"} Jul 22 01:55:45.377154 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:45.377110 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:55:45.377463 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:45.377190 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:55:45.377463 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:45.377222 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:55:46.258197 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:46.258155 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" event={"ID":"13627a72-d395-4625-820a-8aae268245ce","Type":"ContainerStarted","Data":"9928865f8c814fe065bf3dcea526c3ca4704a1fdc40bd25e7df32490628fd96b"} Jul 22 01:55:46.279943 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:46.279880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" podStartSLOduration=1.5510904939999999 podStartE2EDuration="4.279841194s" totalImagesPullingTime="2.7287507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:55:46.278171495 +0000 UTC m=+483.958827048" watchObservedRunningTime="2026-07-22 01:55:46.279841194 +0000 UTC m=+483.960496745" Jul 22 01:55:46.485564 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:46.485520 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:46.490936 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:46.490907 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:47.270251 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.270204 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:47.271677 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.271651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:55:47.561944 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.561836 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:55:47.565551 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.565531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.567924 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.567886 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 01:55:47.573431 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.573403 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:55:47.606784 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.606738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:55:47.641815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.641765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68kl6\" (UniqueName: \"kubernetes.io/projected/f01bffe8-67c6-4300-bc66-02cd5cc520e5-kube-api-access-68kl6\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.641815 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.641817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f01bffe8-67c6-4300-bc66-02cd5cc520e5-config-file\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.743158 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.743116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68kl6\" (UniqueName: \"kubernetes.io/projected/f01bffe8-67c6-4300-bc66-02cd5cc520e5-kube-api-access-68kl6\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.743352 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.743168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f01bffe8-67c6-4300-bc66-02cd5cc520e5-config-file\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.743844 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.743821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f01bffe8-67c6-4300-bc66-02cd5cc520e5-config-file\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.752021 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.751992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68kl6\" (UniqueName: \"kubernetes.io/projected/f01bffe8-67c6-4300-bc66-02cd5cc520e5-kube-api-access-68kl6\") pod \"limitador-limitador-54d6d988d5-bwwbw\" (UID: \"f01bffe8-67c6-4300-bc66-02cd5cc520e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:47.878484 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:47.878370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:48.027841 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:48.027762 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:55:48.030976 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:55:48.030948 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01bffe8_67c6_4300_bc66_02cd5cc520e5.slice/crio-8549d369f9cd953c3eac0fb63f38d09b506904d4158d05482e700f802b4c5033 WatchSource:0}: Error finding container 8549d369f9cd953c3eac0fb63f38d09b506904d4158d05482e700f802b4c5033: Status 404 returned error can't find the container with id 8549d369f9cd953c3eac0fb63f38d09b506904d4158d05482e700f802b4c5033 Jul 22 01:55:48.275331 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:48.275287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" event={"ID":"f01bffe8-67c6-4300-bc66-02cd5cc520e5","Type":"ContainerStarted","Data":"8549d369f9cd953c3eac0fb63f38d09b506904d4158d05482e700f802b4c5033"} Jul 22 01:55:51.292663 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:51.292630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" event={"ID":"f01bffe8-67c6-4300-bc66-02cd5cc520e5","Type":"ContainerStarted","Data":"141093c7205d26b1b7d926e967d946210e1f8273124d24c6d05e0370742472a9"} Jul 22 01:55:51.293081 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:51.292700 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:55:51.310140 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:55:51.310078 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" podStartSLOduration=1.711978418 podStartE2EDuration="4.31005684s" totalImagesPullingTime="2.598078422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:55:51.307942058 +0000 UTC m=+488.988597606" watchObservedRunningTime="2026-07-22 01:55:51.31005684 +0000 UTC m=+488.990712389" Jul 22 01:56:02.300844 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:56:02.300803 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bwwbw" Jul 22 01:56:59.756120 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:56:59.756022 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:57:07.689980 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.689937 2564 generic.go:356] "Generic (PLEG): container finished" podID="13627a72-d395-4625-820a-8aae268245ce" containerID="9928865f8c814fe065bf3dcea526c3ca4704a1fdc40bd25e7df32490628fd96b" exitCode=0 Jul 22 01:57:07.690472 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.690012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" event={"ID":"13627a72-d395-4625-820a-8aae268245ce","Type":"ContainerDied","Data":"9928865f8c814fe065bf3dcea526c3ca4704a1fdc40bd25e7df32490628fd96b"} Jul 22 01:57:07.690472 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.690470 2564 scope.go:117] "RemoveContainer" containerID="9928865f8c814fe065bf3dcea526c3ca4704a1fdc40bd25e7df32490628fd96b" Jul 22 01:57:07.691563 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.691530 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:57:07.691632 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.691611 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:57:07.691671 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:07.691643 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:57:08.696551 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:08.696511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" event={"ID":"13627a72-d395-4625-820a-8aae268245ce","Type":"ContainerStarted","Data":"ff2e824a25a21c84241674040299ed333ef7b4de60757b4b166ceebb64710a65"} Jul 22 01:57:09.485094 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:09.485040 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:57:09.485360 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:09.485333 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-68nmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" start-of-body= Jul 22 01:57:09.485413 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:09.485393 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" podUID="13627a72-d395-4625-820a-8aae268245ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" Jul 22 01:57:10.485611 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:10.485572 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-68nmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" start-of-body= Jul 22 01:57:10.486052 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:10.485635 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" podUID="13627a72-d395-4625-820a-8aae268245ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" Jul 22 01:57:11.485394 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:11.485349 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-68nmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" start-of-body= Jul 22 01:57:11.485597 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:11.485413 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" podUID="13627a72-d395-4625-820a-8aae268245ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" Jul 22 01:57:12.486007 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:12.485964 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-68nmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" start-of-body= Jul 22 01:57:12.486431 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:12.486030 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" podUID="13627a72-d395-4625-820a-8aae268245ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.29:15021/healthz/ready\": dial tcp 10.135.0.29:15021: connect: connection refused" Jul 22 01:57:13.489571 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:13.489536 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:57:13.490058 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:13.489980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:57:13.490877 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:13.490839 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-68nmw" Jul 22 01:57:20.248124 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:20.248081 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:57:25.856887 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:25.856833 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:57:31.849910 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.849843 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp"] Jul 22 01:57:31.853614 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.853589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.857145 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.857107 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 01:57:31.857145 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.857107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2n9gm\"" Jul 22 01:57:31.857363 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.857226 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 01:57:31.857363 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.857228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 01:57:31.858351 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.858486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.858486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.858486 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.858612 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsb6p\" (UniqueName: \"kubernetes.io/projected/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-kube-api-access-hsb6p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.858612 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.858536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.863141 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.863111 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp"] Jul 22 01:57:31.959248 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959248 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb6p\" (UniqueName: \"kubernetes.io/projected/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-kube-api-access-hsb6p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959501 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959804 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959775 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959927 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959786 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.959927 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.959824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.961776 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.961753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.962081 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.962060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:31.967840 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:31.967813 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsb6p\" (UniqueName: \"kubernetes.io/projected/7c85f767-b367-482c-9aa3-8d93d0fdeeeb-kube-api-access-hsb6p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kk7tp\" (UID: \"7c85f767-b367-482c-9aa3-8d93d0fdeeeb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:32.165533 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:32.165492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:32.310924 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:32.310808 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp"] Jul 22 01:57:32.314039 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:57:32.314002 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c85f767_b367_482c_9aa3_8d93d0fdeeeb.slice/crio-3f665a57040c24f36e2b882a3a525d6e74ea4e571fa29570eec9f2632158d49c WatchSource:0}: Error finding container 3f665a57040c24f36e2b882a3a525d6e74ea4e571fa29570eec9f2632158d49c: Status 404 returned error can't find the container with id 3f665a57040c24f36e2b882a3a525d6e74ea4e571fa29570eec9f2632158d49c Jul 22 01:57:32.829286 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:32.829239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" event={"ID":"7c85f767-b367-482c-9aa3-8d93d0fdeeeb","Type":"ContainerStarted","Data":"3f665a57040c24f36e2b882a3a525d6e74ea4e571fa29570eec9f2632158d49c"} Jul 22 01:57:33.054853 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:33.054809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:57:33.836127 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:33.836085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" event={"ID":"7c85f767-b367-482c-9aa3-8d93d0fdeeeb","Type":"ContainerStarted","Data":"6f6eafd527bf4193fe1a972cf67794788edb138bae82580613519bfa8bf53ade"} Jul 22 01:57:33.855667 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:33.855607 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" podStartSLOduration=1.816827972 podStartE2EDuration="2.855588475s" totalImagesPullingTime="1.038760503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:57:33.853455024 +0000 UTC m=+591.534110574" watchObservedRunningTime="2026-07-22 01:57:33.855588475 +0000 UTC m=+591.536244025" Jul 22 01:57:42.166041 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:42.165986 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:42.166481 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:42.166077 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:42.179038 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:42.179007 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:42.892359 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:42.892315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kk7tp" Jul 22 01:57:47.950618 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:57:47.950571 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:58:03.850435 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:03.850340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:58:10.547966 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.547921 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469"] Jul 22 01:58:10.551761 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.551730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.554136 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.554109 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 22 01:58:10.559786 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.559745 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469"] Jul 22 01:58:10.728336 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.728336 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.728569 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.728569 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l268j\" (UniqueName: \"kubernetes.io/projected/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-kube-api-access-l268j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.728569 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.728666 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.728601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830249 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830249 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l268j\" (UniqueName: \"kubernetes.io/projected/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-kube-api-access-l268j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830249 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830515 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830515 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830515 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830648 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830702 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830659 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.830702 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.830695 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.832983 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.832956 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.833252 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.833231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.838422 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.838389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l268j\" (UniqueName: \"kubernetes.io/projected/e1a2e724-eb1c-4810-a8a6-8f0b15275f98-kube-api-access-l268j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gv469\" (UID: \"e1a2e724-eb1c-4810-a8a6-8f0b15275f98\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:10.863469 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:10.863430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:11.013349 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:11.013321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469"] Jul 22 01:58:11.016342 ip-10-0-132-26 kubenswrapper[2564]: W0722 01:58:11.016310 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1a2e724_eb1c_4810_a8a6_8f0b15275f98.slice/crio-67ff7fa5aff268c818693d1497479ec4889a5633924ee8fd4f1ff2fc5319336b WatchSource:0}: Error finding container 67ff7fa5aff268c818693d1497479ec4889a5633924ee8fd4f1ff2fc5319336b: Status 404 returned error can't find the container with id 67ff7fa5aff268c818693d1497479ec4889a5633924ee8fd4f1ff2fc5319336b Jul 22 01:58:11.018186 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:11.018162 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:58:12.024030 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:12.023988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" event={"ID":"e1a2e724-eb1c-4810-a8a6-8f0b15275f98","Type":"ContainerStarted","Data":"fa3daa4872c1a56de6506586b013b1763c77b7a72a410ee73d0e86ebb09ea6b1"} Jul 22 01:58:12.024447 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:12.024044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" event={"ID":"e1a2e724-eb1c-4810-a8a6-8f0b15275f98","Type":"ContainerStarted","Data":"67ff7fa5aff268c818693d1497479ec4889a5633924ee8fd4f1ff2fc5319336b"} Jul 22 01:58:12.040378 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:12.040294 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" podStartSLOduration=1.872513211 podStartE2EDuration="2.040277839s" totalImagesPullingTime="167.764628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:58:12.039912817 +0000 UTC m=+629.720568369" watchObservedRunningTime="2026-07-22 01:58:12.040277839 +0000 UTC m=+629.720933412" Jul 22 01:58:13.062581 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:13.062544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:58:20.864007 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:20.863959 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:20.864476 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:20.864026 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:20.877130 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:20.877099 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:58:21.080334 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:58:21.080299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gv469" Jul 22 01:59:28.653577 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:59:28.653537 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:59:39.253679 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:59:39.253575 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 01:59:49.862701 ip-10-0-132-26 kubenswrapper[2564]: I0722 01:59:49.862645 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:01:31.548469 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:01:31.548420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:01:40.755154 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:01:40.755121 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:01:53.847666 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:01:53.847625 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:09.852042 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:09.851993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:20.057598 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:20.057554 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:28.957133 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:28.957088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:37.959047 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:37.955069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:47.951021 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:47.950978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:02:57.947124 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:02:57.947065 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:03:09.542589 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:03:09.542545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:03:19.264399 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:03:19.264355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:03:42.257712 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:03:42.257672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:03:51.945935 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:03:51.945886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:04:13.946582 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:04:13.946499 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:04:23.754661 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:04:23.754611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:04:41.249026 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:04:41.248983 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:04:50.759465 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:04:50.759419 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:05:00.260758 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:05:00.260711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:05:09.854492 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:05:09.854450 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:05:18.758329 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:05:18.758293 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:07:09.547320 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:07:09.547280 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:07:19.059201 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:07:19.059165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:07:31.655159 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:07:31.655118 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:07:43.253902 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:07:43.253844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:07:53.650608 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:07:53.650562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:05.157406 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:05.157370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:14.148856 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:14.148813 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:25.251832 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:25.251792 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:34.877004 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:34.876902 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:45.850817 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:45.850771 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:08:58.242620 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:08:58.242580 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:09:19.863274 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:09:19.863235 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:09:30.055314 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:09:30.055269 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:09:46.557956 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:09:46.557917 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:10:05.482419 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:10:05.482316 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:10:22.057050 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:10:22.057012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:10:35.852717 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:10:35.852664 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:10:44.657921 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:10:44.657878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:10:56.252615 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:10:56.252574 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:05.547573 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:05.547530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:14.348948 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:14.348902 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:24.956840 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:24.956800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:33.847798 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:33.847713 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:43.350857 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:43.350812 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:11:56.559817 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:11:56.559769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:06.050346 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:06.050300 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:15.551342 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:15.551294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:25.256704 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:25.256653 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:39.255202 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:39.255157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:47.164031 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:47.163990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:12:58.151635 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:12:58.151596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:10.152386 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:10.152289 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:21.355667 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:21.355611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:30.359439 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:30.359391 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:43.351035 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:43.350988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:52.151717 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:52.151674 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:13:58.330085 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.330048 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:13:58.333725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.333701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.336335 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.336308 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-45f6f391-openshift-default-dockercfg-4gg2f\"" Jul 22 02:13:58.365459 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.365419 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:13:58.435953 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.435899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.435967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436376 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrgw\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436376 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436479 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.436479 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.436456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538087 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538087 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrgw\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.538939 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.539228 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.539228 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.538992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.539228 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.539034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.539228 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.539183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.540923 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.540901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.541073 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.541056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.549411 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.549372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.549543 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.549459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrgw\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw\") pod \"e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.645993 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.645957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:13:58.813433 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.813273 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:13:58.815951 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:13:58.815919 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7287eae5_d69b_4e85_b92e_3387a8a05539.slice/crio-88bb3a6fd1aa791e03d3d74e41e5e009d84b7e4584b0add6ab256af3f4f507cb WatchSource:0}: Error finding container 88bb3a6fd1aa791e03d3d74e41e5e009d84b7e4584b0add6ab256af3f4f507cb: Status 404 returned error can't find the container with id 88bb3a6fd1aa791e03d3d74e41e5e009d84b7e4584b0add6ab256af3f4f507cb Jul 22 02:13:58.818429 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.818381 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:13:58.818537 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.818486 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:13:58.818577 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:58.818533 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:13:59.804966 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:59.804922 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerStarted","Data":"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713"} Jul 22 02:13:59.805497 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:59.804990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerStarted","Data":"88bb3a6fd1aa791e03d3d74e41e5e009d84b7e4584b0add6ab256af3f4f507cb"} Jul 22 02:13:59.828823 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:13:59.828763 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podStartSLOduration=1.828744472 podStartE2EDuration="1.828744472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:13:59.826368803 +0000 UTC m=+1577.507024345" watchObservedRunningTime="2026-07-22 02:13:59.828744472 +0000 UTC m=+1577.509400001" Jul 22 02:14:00.646934 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:00.646887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:00.652174 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:00.652140 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:00.810615 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:00.810573 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:00.811590 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:00.811568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:08.259589 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:08.259549 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:14:16.657456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.656874 2564 patch_prober.go:28] interesting pod/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.135.0.33:15021/healthz/ready\": read tcp 10.135.0.2:59676->10.135.0.33:15021: read: connection reset by peer" start-of-body= Jul 22 02:14:16.657456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.656948 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.33:15021/healthz/ready\": read tcp 10.135.0.2:59676->10.135.0.33:15021: read: connection reset by peer" Jul 22 02:14:16.894199 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.894164 2564 generic.go:356] "Generic (PLEG): container finished" podID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerID="07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713" exitCode=0 Jul 22 02:14:16.894396 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.894248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerDied","Data":"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713"} Jul 22 02:14:16.894768 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.894752 2564 scope.go:117] "RemoveContainer" containerID="07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713" Jul 22 02:14:16.895908 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.895856 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:16.896033 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.896005 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:16.896083 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:16.896043 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:17.905549 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:17.905507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerStarted","Data":"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7"} Jul 22 02:14:18.646509 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:18.646460 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:18.646736 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:18.646696 2564 patch_prober.go:28] interesting pod/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" start-of-body= Jul 22 02:14:18.646812 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:18.646756 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" Jul 22 02:14:19.647126 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:19.647085 2564 patch_prober.go:28] interesting pod/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" start-of-body= Jul 22 02:14:19.647514 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:19.647144 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" Jul 22 02:14:20.646677 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:20.646638 2564 patch_prober.go:28] interesting pod/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" start-of-body= Jul 22 02:14:20.646912 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:20.646707 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" Jul 22 02:14:21.646499 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:21.646448 2564 patch_prober.go:28] interesting pod/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" start-of-body= Jul 22 02:14:21.646966 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:21.646560 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.33:15021/healthz/ready\": dial tcp 10.135.0.33:15021: connect: connection refused" Jul 22 02:14:22.650321 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:22.650283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:22.650808 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:22.650606 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:22.651661 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:22.651640 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:40.149024 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:40.148931 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:14:42.077937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:42.077902 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:14:42.078405 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:42.078157 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" containerID="cri-o://ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7" gracePeriod=30 Jul 22 02:14:47.340265 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.340185 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:47.439697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439661 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439707 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439738 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439781 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvrgw\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439907 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439934 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.439963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs\") pod \"7287eae5-d69b-4e85-b92e-3387a8a05539\" (UID: \"7287eae5-d69b-4e85-b92e-3387a8a05539\") " Jul 22 02:14:47.440424 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.440282 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:14:47.440524 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.440494 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:14:47.440730 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.440631 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:14:47.440821 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.440755 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:14:47.441427 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.441399 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data" (OuterVolumeSpecName: "istio-data") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:14:47.442379 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.442343 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw" (OuterVolumeSpecName: "kube-api-access-wvrgw") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "kube-api-access-wvrgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:47.442554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.442536 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:14:47.442554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.442543 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:14:47.442738 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.442710 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token" (OuterVolumeSpecName: "istio-token") pod "7287eae5-d69b-4e85-b92e-3387a8a05539" (UID: "7287eae5-d69b-4e85-b92e-3387a8a05539"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541093 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-envoy\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541142 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-podinfo\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541151 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7287eae5-d69b-4e85-b92e-3387a8a05539-istiod-ca-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541159 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvrgw\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-kube-api-access-wvrgw\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541167 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-data\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541176 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-credential-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541594 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541186 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541594 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541195 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287eae5-d69b-4e85-b92e-3387a8a05539-istio-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:47.541594 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:47.541204 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287eae5-d69b-4e85-b92e-3387a8a05539-workload-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:14:48.077782 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.077745 2564 generic.go:356] "Generic (PLEG): container finished" podID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerID="ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7" exitCode=0 Jul 22 02:14:48.078015 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.077804 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" Jul 22 02:14:48.078015 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.077829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerDied","Data":"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7"} Jul 22 02:14:48.078015 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.077922 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt" event={"ID":"7287eae5-d69b-4e85-b92e-3387a8a05539","Type":"ContainerDied","Data":"88bb3a6fd1aa791e03d3d74e41e5e009d84b7e4584b0add6ab256af3f4f507cb"} Jul 22 02:14:48.078015 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.077949 2564 scope.go:117] "RemoveContainer" containerID="ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7" Jul 22 02:14:48.088227 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.088206 2564 scope.go:117] "RemoveContainer" containerID="07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713" Jul 22 02:14:48.097723 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.097698 2564 scope.go:117] "RemoveContainer" containerID="ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7" Jul 22 02:14:48.098121 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:14:48.098099 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7\": container with ID starting with ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7 not found: ID does not exist" containerID="ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7" Jul 22 02:14:48.098218 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.098128 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7"} err="failed to get container status \"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7\": rpc error: code = NotFound desc = could not find container \"ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7\": container with ID starting with ab8bd8ae3be8a818d215d586cda4521f899a3cbe6b658708acb1ac9a73403ac7 not found: ID does not exist" Jul 22 02:14:48.098218 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.098148 2564 scope.go:117] "RemoveContainer" containerID="07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713" Jul 22 02:14:48.098412 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:14:48.098392 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713\": container with ID starting with 07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713 not found: ID does not exist" containerID="07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713" Jul 22 02:14:48.098457 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.098419 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713"} err="failed to get container status \"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713\": rpc error: code = NotFound desc = could not find container \"07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713\": container with ID starting with 07f91f386bb2490ae573a09a4ede9b7caf757ae4fb23d3c436825d61b0816713 not found: ID does not exist" Jul 22 02:14:48.099513 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.099493 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:14:48.103377 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.103349 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-45f6f391-openshift-default-c4ddc88cf-9cskt"] Jul 22 02:14:48.756974 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:48.756943 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" path="/var/lib/kubelet/pods/7287eae5-d69b-4e85-b92e-3387a8a05539/volumes" Jul 22 02:14:50.846642 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:14:50.846591 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:15:24.347664 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:15:24.347613 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:15:35.755101 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:15:35.755059 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:16:09.552085 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:09.552039 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:16:13.254353 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.254312 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:16:13.254795 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.254784 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:16:13.254795 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.254797 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:16:13.254892 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.254885 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:16:13.254932 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.254899 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:16:13.258391 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.258363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.260933 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.260909 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-404405cc-openshift-default-dockercfg-lhqz8\"" Jul 22 02:16:13.271295 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.271263 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:16:13.304358 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304358 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rqn\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304600 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304600 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304600 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304702 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304702 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304766 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.304766 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.304752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405427 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405427 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rqn\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.405691 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406017 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.405710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406090 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.406057 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406157 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.406120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406211 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.406172 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406258 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.406209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.406425 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.406406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.408193 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.408170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.408309 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.408286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.414682 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.414658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.414910 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.414888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rqn\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn\") pod \"e2e-derive-404405cc-openshift-default-6977876c99-77xhh\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.570725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.570608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:13.735743 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.735716 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:16:13.738929 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:16:13.738897 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a55b7f_4b96_4a2c_9b34_13ae3b51800d.slice/crio-24c6cb1c9ec079aaeca0f37bd871a4b6ecee3691012732c163b43e0ef2c34bed WatchSource:0}: Error finding container 24c6cb1c9ec079aaeca0f37bd871a4b6ecee3691012732c163b43e0ef2c34bed: Status 404 returned error can't find the container with id 24c6cb1c9ec079aaeca0f37bd871a4b6ecee3691012732c163b43e0ef2c34bed Jul 22 02:16:13.741307 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.741267 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:13.741385 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.741367 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:13.741423 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:13.741409 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:14.516639 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:14.516592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerStarted","Data":"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b"} Jul 22 02:16:14.517127 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:14.516662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerStarted","Data":"24c6cb1c9ec079aaeca0f37bd871a4b6ecee3691012732c163b43e0ef2c34bed"} Jul 22 02:16:14.547333 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:14.547273 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podStartSLOduration=1.547250689 podStartE2EDuration="1.547250689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:14.545671869 +0000 UTC m=+1712.226327432" watchObservedRunningTime="2026-07-22 02:16:14.547250689 +0000 UTC m=+1712.227906217" Jul 22 02:16:14.571256 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:14.571213 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:14.576811 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:14.576776 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:15.523138 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:15.523104 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:15.524274 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:15.524251 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:21.853847 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:21.853790 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:16:30.524373 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.524327 2564 patch_prober.go:28] interesting pod/e2e-derive-404405cc-openshift-default-6977876c99-77xhh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" start-of-body= Jul 22 02:16:30.524972 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.524417 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" Jul 22 02:16:30.612671 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.612630 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerID="32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b" exitCode=0 Jul 22 02:16:30.612896 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.612705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerDied","Data":"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b"} Jul 22 02:16:30.613352 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.613333 2564 scope.go:117] "RemoveContainer" containerID="32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b" Jul 22 02:16:30.614498 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.614469 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:30.614563 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.614550 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:30.614615 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:30.614601 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:16:31.619526 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:31.619490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerStarted","Data":"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f"} Jul 22 02:16:32.571809 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:32.571763 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:32.572084 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:32.572058 2564 patch_prober.go:28] interesting pod/e2e-derive-404405cc-openshift-default-6977876c99-77xhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" start-of-body= Jul 22 02:16:32.572151 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:32.572128 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" Jul 22 02:16:33.571911 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:33.571850 2564 patch_prober.go:28] interesting pod/e2e-derive-404405cc-openshift-default-6977876c99-77xhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" start-of-body= Jul 22 02:16:33.572327 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:33.571935 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" Jul 22 02:16:34.571917 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:34.571838 2564 patch_prober.go:28] interesting pod/e2e-derive-404405cc-openshift-default-6977876c99-77xhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" start-of-body= Jul 22 02:16:34.572370 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:34.571939 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" Jul 22 02:16:35.571602 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:35.571551 2564 patch_prober.go:28] interesting pod/e2e-derive-404405cc-openshift-default-6977876c99-77xhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" start-of-body= Jul 22 02:16:35.571820 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:35.571639 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.34:15021/healthz/ready\": dial tcp 10.135.0.34:15021: connect: connection refused" Jul 22 02:16:36.576739 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:36.576679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:36.577201 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:36.577117 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:36.578037 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:36.578012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:16:54.255116 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:54.255078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:16:56.146082 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:56.146037 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:16:56.146523 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:16:56.146333 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" containerID="cri-o://e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f" gracePeriod=30 Jul 22 02:17:01.420554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.420473 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:17:01.514876 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.514831 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.514929 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.514957 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.514973 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515002 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515024 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98rqn\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515374 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515143 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515374 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515171 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.515374 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515237 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:17:01.515537 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515353 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:17:01.515537 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515404 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:17:01.515537 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515421 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:17:01.515683 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.515560 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo\") pod \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\" (UID: \"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d\") " Jul 22 02:17:01.516142 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.516120 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.516238 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.516159 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-workload-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.516295 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.516250 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:17:01.516334 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.516263 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istiod-ca-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.516367 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.516338 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-credential-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.517547 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.517521 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:17:01.517749 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.517731 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:17:01.518011 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.517990 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn" (OuterVolumeSpecName: "kube-api-access-98rqn") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "kube-api-access-98rqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:17:01.518086 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.517992 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" (UID: "d7a55b7f-4b96-4a2c-9b34-13ae3b51800d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:17:01.617371 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.617310 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.617371 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.617360 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-envoy\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.617371 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.617371 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98rqn\" (UniqueName: \"kubernetes.io/projected/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-kube-api-access-98rqn\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.617371 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.617379 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-data\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.617371 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.617389 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d-istio-podinfo\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:17:01.781009 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.780912 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerID="e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f" exitCode=0 Jul 22 02:17:01.781009 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.780997 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" Jul 22 02:17:01.781194 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.780998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerDied","Data":"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f"} Jul 22 02:17:01.781194 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.781071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh" event={"ID":"d7a55b7f-4b96-4a2c-9b34-13ae3b51800d","Type":"ContainerDied","Data":"24c6cb1c9ec079aaeca0f37bd871a4b6ecee3691012732c163b43e0ef2c34bed"} Jul 22 02:17:01.781194 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.781103 2564 scope.go:117] "RemoveContainer" containerID="e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f" Jul 22 02:17:01.791305 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.791285 2564 scope.go:117] "RemoveContainer" containerID="32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b" Jul 22 02:17:01.801229 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.801201 2564 scope.go:117] "RemoveContainer" containerID="e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f" Jul 22 02:17:01.801601 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:17:01.801568 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f\": container with ID starting with e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f not found: ID does not exist" containerID="e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f" Jul 22 02:17:01.801710 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.801606 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f"} err="failed to get container status \"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f\": rpc error: code = NotFound desc = could not find container \"e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f\": container with ID starting with e768496e98a9f9cd74c2a2ed778a754dd3040aeed269a579f84e02c9cb09066f not found: ID does not exist" Jul 22 02:17:01.801710 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.801628 2564 scope.go:117] "RemoveContainer" containerID="32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b" Jul 22 02:17:01.801981 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:17:01.801950 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b\": container with ID starting with 32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b not found: ID does not exist" containerID="32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b" Jul 22 02:17:01.802063 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.801989 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b"} err="failed to get container status \"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b\": rpc error: code = NotFound desc = could not find container \"32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b\": container with ID starting with 32ccde94448a036b63daad1db390d5d7e21b2243ae0cb66da73a0d1cad8b208b not found: ID does not exist" Jul 22 02:17:01.803474 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.803447 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:17:01.807245 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:01.807219 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-404405cc-openshift-default-6977876c99-77xhh"] Jul 22 02:17:02.755664 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:17:02.755629 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" path="/var/lib/kubelet/pods/d7a55b7f-4b96-4a2c-9b34-13ae3b51800d/volumes" Jul 22 02:18:27.252088 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:27.252044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:18:37.957566 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:37.957523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:18:41.182078 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182038 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:18:41.182459 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182443 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.182459 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182455 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.182528 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182474 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:18:41.182528 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182480 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7287eae5-d69b-4e85-b92e-3387a8a05539" containerName="istio-proxy" Jul 22 02:18:41.182528 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182492 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.182528 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182498 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.182650 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182558 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.182650 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.182570 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a55b7f-4b96-4a2c-9b34-13ae3b51800d" containerName="istio-proxy" Jul 22 02:18:41.185969 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.185946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.188558 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.188531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f050ef22-openshift-default-dockercfg-khffz\"" Jul 22 02:18:41.210961 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.210921 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:18:41.323933 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.323854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sxv8\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324155 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.323979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324155 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324155 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324155 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324317 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324317 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324317 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.324317 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.324307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425269 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425772 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425772 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxv8\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.425772 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425739 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.426022 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.425991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.426022 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.426015 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.426168 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.426099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.426489 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.426470 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.428040 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.428012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.428239 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.428219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.433792 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.433724 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.433912 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.433884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sxv8\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8\") pod \"e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.497076 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.497019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:41.653421 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.653393 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:18:41.656441 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:18:41.656398 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae29ab2_65bf_4fa3_abd9_866bbfcbb7e5.slice/crio-e8a56aa3cc863e165a32ca9350571e95028e8b8ebc79f9f81069e4bbf046fd6d WatchSource:0}: Error finding container e8a56aa3cc863e165a32ca9350571e95028e8b8ebc79f9f81069e4bbf046fd6d: Status 404 returned error can't find the container with id e8a56aa3cc863e165a32ca9350571e95028e8b8ebc79f9f81069e4bbf046fd6d Jul 22 02:18:41.659059 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.659020 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:18:41.659171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.659099 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:18:41.659171 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:41.659129 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:18:42.316544 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:42.316498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerStarted","Data":"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34"} Jul 22 02:18:42.316978 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:42.316566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerStarted","Data":"e8a56aa3cc863e165a32ca9350571e95028e8b8ebc79f9f81069e4bbf046fd6d"} Jul 22 02:18:42.336339 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:42.336276 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podStartSLOduration=1.3362572529999999 podStartE2EDuration="1.336257253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:18:42.335363408 +0000 UTC m=+1860.016018961" watchObservedRunningTime="2026-07-22 02:18:42.336257253 +0000 UTC m=+1860.016912852" Jul 22 02:18:42.498130 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:42.498085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:42.503647 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:42.503614 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:43.322425 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:43.322386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:43.323719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:43.323698 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:18:50.899354 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:50.899308 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:18:59.186939 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.185713 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.135.0.35:15021/healthz/ready\": read tcp 10.135.0.2:47326->10.135.0.35:15021: read: connection reset by peer" start-of-body= Jul 22 02:18:59.186939 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.185784 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.35:15021/healthz/ready\": read tcp 10.135.0.2:47326->10.135.0.35:15021: read: connection reset by peer" Jul 22 02:18:59.408194 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.408162 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerID="bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34" exitCode=0 Jul 22 02:18:59.408386 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.408243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerDied","Data":"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34"} Jul 22 02:18:59.408712 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.408698 2564 scope.go:117] "RemoveContainer" containerID="bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34" Jul 22 02:18:59.409847 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.409818 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:18:59.409926 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.409916 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:18:59.409965 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:18:59.409951 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:00.420468 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:00.420416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerStarted","Data":"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b"} Jul 22 02:19:00.501148 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:00.501041 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:00.501909 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:00.501837 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" start-of-body= Jul 22 02:19:00.502054 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:00.501951 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" Jul 22 02:19:01.497952 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:01.497901 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" start-of-body= Jul 22 02:19:01.499118 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:01.498597 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" Jul 22 02:19:02.498249 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:02.498200 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" start-of-body= Jul 22 02:19:02.498786 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:02.498284 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" Jul 22 02:19:03.498401 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:03.498296 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" start-of-body= Jul 22 02:19:03.498401 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:03.498373 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.35:15021/healthz/ready\": dial tcp 10.135.0.35:15021: connect: connection refused" Jul 22 02:19:04.502053 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:04.502016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:04.502518 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:04.502294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:04.503269 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:04.503250 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:09.949497 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:09.949454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:19:18.029970 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:18.029928 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:19:18.030486 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:18.030248 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" containerID="cri-o://b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b" gracePeriod=30 Jul 22 02:19:19.504931 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:19.504887 2564 patch_prober.go:28] interesting pod/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 02:19:19.505325 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:19.504966 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:19:23.291028 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.290992 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:23.379719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379618 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.379719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.379719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379706 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.379719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379725 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380105 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379749 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380105 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379782 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sxv8\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380105 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379842 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380105 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379928 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380105 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.379955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs\") pod \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\" (UID: \"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5\") " Jul 22 02:19:23.380356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.380183 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:19:23.380356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.380335 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.380504 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.380461 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:19:23.380567 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.380468 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:19:23.380673 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.380583 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:19:23.381203 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.381178 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:19:23.382237 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.382215 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:19:23.382390 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.382372 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:19:23.382753 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.382723 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:19:23.382753 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.382732 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8" (OuterVolumeSpecName: "kube-api-access-7sxv8") pod "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" (UID: "0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5"). InnerVolumeSpecName "kube-api-access-7sxv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:19:23.481243 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481194 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-envoy\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481243 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481229 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-data\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481243 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481246 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-workload-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481500 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481257 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-credential-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481500 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481269 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-podinfo\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481500 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481281 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istio-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481500 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481291 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-istiod-ca-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.481500 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.481301 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sxv8\" (UniqueName: \"kubernetes.io/projected/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5-kube-api-access-7sxv8\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:19:23.539723 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.539685 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerID="b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b" exitCode=0 Jul 22 02:19:23.539937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.539738 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" Jul 22 02:19:23.539937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.539749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerDied","Data":"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b"} Jul 22 02:19:23.539937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.539828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k" event={"ID":"0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5","Type":"ContainerDied","Data":"e8a56aa3cc863e165a32ca9350571e95028e8b8ebc79f9f81069e4bbf046fd6d"} Jul 22 02:19:23.539937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.539853 2564 scope.go:117] "RemoveContainer" containerID="b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b" Jul 22 02:19:23.552214 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.552191 2564 scope.go:117] "RemoveContainer" containerID="bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34" Jul 22 02:19:23.562021 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.561993 2564 scope.go:117] "RemoveContainer" containerID="b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b" Jul 22 02:19:23.562375 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:19:23.562353 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b\": container with ID starting with b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b not found: ID does not exist" containerID="b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b" Jul 22 02:19:23.562457 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.562389 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b"} err="failed to get container status \"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b\": rpc error: code = NotFound desc = could not find container \"b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b\": container with ID starting with b7868f33b8846df8a3a4fb852b9da4de7abd50e415c1c4d6497e55a30ca1373b not found: ID does not exist" Jul 22 02:19:23.562457 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.562414 2564 scope.go:117] "RemoveContainer" containerID="bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34" Jul 22 02:19:23.562732 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:19:23.562712 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34\": container with ID starting with bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34 not found: ID does not exist" containerID="bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34" Jul 22 02:19:23.562780 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.562739 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34"} err="failed to get container status \"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34\": rpc error: code = NotFound desc = could not find container \"bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34\": container with ID starting with bf6f1cc1c9f9a8cb562c7eba6b14e15ccd84c4091766882f194fd2fc0b6c4f34 not found: ID does not exist" Jul 22 02:19:23.563516 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.563495 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:19:23.566845 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:23.566817 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f050ef22-openshift-default-77b79fc667-mgn8k"] Jul 22 02:19:24.756445 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:24.756406 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" path="/var/lib/kubelet/pods/0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5/volumes" Jul 22 02:19:46.855085 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:46.855041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:19:59.250063 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:19:59.250026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:20:15.159595 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:20:15.159552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:20:32.653001 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:20:32.652952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:20:43.648611 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:20:43.648568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:21:33.426513 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:21:33.426461 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:21:43.060396 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:21:43.060349 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:22:36.553135 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:22:36.553086 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:22:47.450021 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:22:47.449967 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:22:56.646318 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:22:56.646272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:23:07.756508 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:07.756465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:23:19.537510 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.537464 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:23:19.538258 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.538217 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:23:19.538258 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.538247 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:23:19.538452 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.538435 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:23:19.541704 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.541668 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.545797 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.545757 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6708c8\"/\"kube-root-ca.crt\"" Jul 22 02:23:19.546032 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.545757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6708c8\"/\"default-dockercfg-4sm69\"" Jul 22 02:23:19.546032 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.545757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6708c8\"/\"test-model-6708c8-kserve-self-signed-certs\"" Jul 22 02:23:19.546535 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.546139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6708c8\"/\"openshift-service-ca.crt\"" Jul 22 02:23:19.552504 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.552466 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:23:19.651460 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.651715 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.651715 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8h7j\" (UniqueName: \"kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.651715 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.651715 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.651947 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.651753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.752640 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.752598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.752852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.752655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.752852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.752688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753025 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.752910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8h7j\" (UniqueName: \"kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753025 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.752970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753025 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.753008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753162 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.753146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753270 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.753247 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.753342 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.753316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.755393 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.755364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.755670 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.755649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.764130 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.764093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8h7j\" (UniqueName: \"kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j\") pod \"test-model-6708c8-kserve-86dfc47c7-82b69\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:19.855660 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:19.855560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:20.017145 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:20.017115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:23:20.020192 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:23:20.020146 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4c2a322_d34d_4786_8cbd_ceb433e67ab8.slice/crio-03c56eb0d85354c5e35b97673b84e206bb88fe79d28fac28d97b67a3edfd55fe WatchSource:0}: Error finding container 03c56eb0d85354c5e35b97673b84e206bb88fe79d28fac28d97b67a3edfd55fe: Status 404 returned error can't find the container with id 03c56eb0d85354c5e35b97673b84e206bb88fe79d28fac28d97b67a3edfd55fe Jul 22 02:23:20.771957 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:20.771914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" event={"ID":"f4c2a322-d34d-4786-8cbd-ceb433e67ab8","Type":"ContainerStarted","Data":"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0"} Jul 22 02:23:20.772403 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:20.771968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" event={"ID":"f4c2a322-d34d-4786-8cbd-ceb433e67ab8","Type":"ContainerStarted","Data":"03c56eb0d85354c5e35b97673b84e206bb88fe79d28fac28d97b67a3edfd55fe"} Jul 22 02:23:20.789421 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:20.789333 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" podStartSLOduration=1.789307507 podStartE2EDuration="1.789307507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:20.787906643 +0000 UTC m=+2138.468562194" watchObservedRunningTime="2026-07-22 02:23:20.789307507 +0000 UTC m=+2138.469963057" Jul 22 02:23:24.354437 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:24.354375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:23:29.855874 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:29.855813 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:29.856269 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:29.855899 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:29.869297 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:29.869258 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:30.838081 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:30.838041 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:23:37.658156 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:23:37.658050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:24:02.154409 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:02.154348 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:24:06.052316 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:06.052264 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:24:17.178761 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.178686 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" podUID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" containerName="main" containerID="cri-o://5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0" gracePeriod=45 Jul 22 02:24:17.451897 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.451852 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:24:17.556596 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556554 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.556596 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556604 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.556922 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556640 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.556922 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556689 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.556922 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556729 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.556922 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556761 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8h7j\" (UniqueName: \"kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j\") pod \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\" (UID: \"f4c2a322-d34d-4786-8cbd-ceb433e67ab8\") " Jul 22 02:24:17.557173 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.556972 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home" (OuterVolumeSpecName: "home") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:17.557173 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.557045 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:17.557173 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.557063 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:17.557347 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.557326 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-home\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:17.557385 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.557355 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-model-cache\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:17.557385 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.557372 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tmp-dir\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:17.559483 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.559432 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j" (OuterVolumeSpecName: "kube-api-access-n8h7j") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "kube-api-access-n8h7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:17.559641 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.559569 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm" (OuterVolumeSpecName: "dshm") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:17.559641 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.559574 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4c2a322-d34d-4786-8cbd-ceb433e67ab8" (UID: "f4c2a322-d34d-4786-8cbd-ceb433e67ab8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:24:17.658287 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.658238 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-dshm\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:17.658287 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.658276 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-tls-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:17.658287 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:17.658290 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8h7j\" (UniqueName: \"kubernetes.io/projected/f4c2a322-d34d-4786-8cbd-ceb433e67ab8-kube-api-access-n8h7j\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:24:18.084709 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.084664 2564 generic.go:356] "Generic (PLEG): container finished" podID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" containerID="5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0" exitCode=0 Jul 22 02:24:18.084986 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.084720 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" Jul 22 02:24:18.084986 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.084749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" event={"ID":"f4c2a322-d34d-4786-8cbd-ceb433e67ab8","Type":"ContainerDied","Data":"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0"} Jul 22 02:24:18.084986 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.084798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69" event={"ID":"f4c2a322-d34d-4786-8cbd-ceb433e67ab8","Type":"ContainerDied","Data":"03c56eb0d85354c5e35b97673b84e206bb88fe79d28fac28d97b67a3edfd55fe"} Jul 22 02:24:18.084986 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.084822 2564 scope.go:117] "RemoveContainer" containerID="5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0" Jul 22 02:24:18.095490 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.095463 2564 scope.go:117] "RemoveContainer" containerID="5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0" Jul 22 02:24:18.095889 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:24:18.095849 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0\": container with ID starting with 5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0 not found: ID does not exist" containerID="5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0" Jul 22 02:24:18.095945 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.095898 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0"} err="failed to get container status \"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0\": rpc error: code = NotFound desc = could not find container \"5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0\": container with ID starting with 5b2aad412ecdfe6cb4aa8f5624ebf869b800e9002203098fcfbbfd7e396e38d0 not found: ID does not exist" Jul 22 02:24:18.108518 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.108477 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:24:18.112186 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.112135 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6708c8/test-model-6708c8-kserve-86dfc47c7-82b69"] Jul 22 02:24:18.666465 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.666408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:24:18.756089 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:18.756047 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" path="/var/lib/kubelet/pods/f4c2a322-d34d-4786-8cbd-ceb433e67ab8/volumes" Jul 22 02:24:37.965443 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:37.965392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:24:47.441959 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.441919 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:24:47.442598 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442578 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:24:47.442598 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442598 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:24:47.442744 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442620 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" containerName="main" Jul 22 02:24:47.442744 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442626 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" containerName="main" Jul 22 02:24:47.442744 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442709 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae29ab2-65bf-4fa3-abd9-866bbfcbb7e5" containerName="istio-proxy" Jul 22 02:24:47.442744 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.442722 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c2a322-d34d-4786-8cbd-ceb433e67ab8" containerName="main" Jul 22 02:24:47.445934 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.445909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.449290 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.449259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-828ede-openshift-default-dockercfg-rczv2\"" Jul 22 02:24:47.466418 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.466378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:24:47.566344 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6847\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.566842 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.566698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.667554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.667554 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.667833 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6847\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.667833 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.667833 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668006 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668006 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.667956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668153 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668128 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668215 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668388 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668463 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668597 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668813 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668796 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.668853 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.668837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.670385 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.670357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.670499 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.670393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.676394 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.676367 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.676726 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.676704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6847\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847\") pod \"e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.759226 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.759120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:47.918517 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.918482 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:24:47.921229 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:24:47.921200 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc6b85f_1bd3_46b3_ba13_988cb0669b36.slice/crio-9a34794321fc241449ebd07a66048b1d8c9b298dc31dde5198be8c48ab0ed61b WatchSource:0}: Error finding container 9a34794321fc241449ebd07a66048b1d8c9b298dc31dde5198be8c48ab0ed61b: Status 404 returned error can't find the container with id 9a34794321fc241449ebd07a66048b1d8c9b298dc31dde5198be8c48ab0ed61b Jul 22 02:24:47.923428 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.923394 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:47.923517 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.923466 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:47.923517 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:47.923494 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:48.252020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:48.251978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerStarted","Data":"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f"} Jul 22 02:24:48.252223 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:48.252042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerStarted","Data":"9a34794321fc241449ebd07a66048b1d8c9b298dc31dde5198be8c48ab0ed61b"} Jul 22 02:24:48.278801 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:48.278739 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podStartSLOduration=1.278719352 podStartE2EDuration="1.278719352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:48.276239974 +0000 UTC m=+2225.956895524" watchObservedRunningTime="2026-07-22 02:24:48.278719352 +0000 UTC m=+2225.959374906" Jul 22 02:24:48.759885 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:48.759838 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:48.765924 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:48.765890 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:49.257355 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:49.257313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:49.258527 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:49.258506 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:24:53.052836 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:24:53.052796 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:25:01.323353 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.323237 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerID="0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f" exitCode=0 Jul 22 02:25:01.323353 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.323295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerDied","Data":"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f"} Jul 22 02:25:01.323837 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.323725 2564 scope.go:117] "RemoveContainer" containerID="0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f" Jul 22 02:25:01.325027 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.324990 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:01.325129 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.325061 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:01.325129 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:01.325095 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:02.330531 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:02.330497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerStarted","Data":"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930"} Jul 22 02:25:02.760177 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:02.760142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:02.761239 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:02.761207 2564 patch_prober.go:28] interesting pod/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:25:02.761399 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:02.761269 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" Jul 22 02:25:03.759756 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:03.759710 2564 patch_prober.go:28] interesting pod/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:25:03.760313 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:03.759779 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" Jul 22 02:25:04.257487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:04.257441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:04.760118 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:04.760078 2564 patch_prober.go:28] interesting pod/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:25:04.760551 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:04.760160 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" Jul 22 02:25:05.760247 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:05.760197 2564 patch_prober.go:28] interesting pod/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" start-of-body= Jul 22 02:25:05.760684 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:05.760282 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.37:15021/healthz/ready\": dial tcp 10.135.0.37:15021: connect: connection refused" Jul 22 02:25:06.159639 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:06.159599 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:25:06.764976 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:06.764939 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:06.766211 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:06.766190 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:33.166466 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:33.166428 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:25:38.126970 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:38.126930 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:25:38.127547 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:38.127174 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" containerID="cri-o://b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930" gracePeriod=30 Jul 22 02:25:43.391844 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.391751 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:43.549515 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.549479 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerID="b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930" exitCode=0 Jul 22 02:25:43.549725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.549543 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" Jul 22 02:25:43.549725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.549566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerDied","Data":"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930"} Jul 22 02:25:43.549725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.549634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk" event={"ID":"ebc6b85f-1bd3-46b3-ba13-988cb0669b36","Type":"ContainerDied","Data":"9a34794321fc241449ebd07a66048b1d8c9b298dc31dde5198be8c48ab0ed61b"} Jul 22 02:25:43.549725 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.549666 2564 scope.go:117] "RemoveContainer" containerID="b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930" Jul 22 02:25:43.555165 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555139 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555324 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555180 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555324 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555204 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555324 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555269 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555326 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555355 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555392 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555418 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6847\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555487 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555444 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo\") pod \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\" (UID: \"ebc6b85f-1bd3-46b3-ba13-988cb0669b36\") " Jul 22 02:25:43.555852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555471 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:25:43.555852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555637 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:43.555852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555698 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:25:43.555852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555838 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.555852 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555858 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-credential-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.556212 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555908 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istiod-ca-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.556212 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.555919 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:25:43.556710 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.556676 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data" (OuterVolumeSpecName: "istio-data") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:25:43.557972 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.557935 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token" (OuterVolumeSpecName: "istio-token") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:43.558147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.558126 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:25:43.558217 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.558159 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847" (OuterVolumeSpecName: "kube-api-access-l6847") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "kube-api-access-l6847". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:43.558217 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.558178 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ebc6b85f-1bd3-46b3-ba13-988cb0669b36" (UID: "ebc6b85f-1bd3-46b3-ba13-988cb0669b36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:25:43.560115 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.560089 2564 scope.go:117] "RemoveContainer" containerID="0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f" Jul 22 02:25:43.578463 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.578440 2564 scope.go:117] "RemoveContainer" containerID="b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930" Jul 22 02:25:43.578834 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:25:43.578812 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930\": container with ID starting with b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930 not found: ID does not exist" containerID="b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930" Jul 22 02:25:43.578932 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.578847 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930"} err="failed to get container status \"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930\": rpc error: code = NotFound desc = could not find container \"b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930\": container with ID starting with b46dc57436307507bfe993cb11ab867d1ac0d7f44f92746cd4665adb6d130930 not found: ID does not exist" Jul 22 02:25:43.578932 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.578893 2564 scope.go:117] "RemoveContainer" containerID="0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f" Jul 22 02:25:43.579198 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:25:43.579176 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f\": container with ID starting with 0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f not found: ID does not exist" containerID="0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f" Jul 22 02:25:43.579288 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.579199 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f"} err="failed to get container status \"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f\": rpc error: code = NotFound desc = could not find container \"0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f\": container with ID starting with 0e9afd68d65b6b6708b1557958ddcb89500d0f1081bf83c4795af18c0b4d672f not found: ID does not exist" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657029 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-envoy\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657070 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-workload-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657083 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-data\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657099 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657111 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6847\" (UniqueName: \"kubernetes.io/projected/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-kube-api-access-l6847\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.657144 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.657137 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebc6b85f-1bd3-46b3-ba13-988cb0669b36-istio-podinfo\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:25:43.883291 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.883242 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:25:43.886330 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:43.886298 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-828ede-openshift-default-79b8d74b4c-b9ckk"] Jul 22 02:25:44.756398 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:44.756362 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" path="/var/lib/kubelet/pods/ebc6b85f-1bd3-46b3-ba13-988cb0669b36/volumes" Jul 22 02:25:59.071675 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:25:59.071626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:26:15.334548 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.334508 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:26:15.335147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.334984 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:26:15.335147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.334997 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:26:15.335147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.335013 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:26:15.335147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.335018 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:26:15.335147 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.335081 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:26:15.338113 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.338092 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.340753 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.340723 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a73722-openshift-default-dockercfg-r8djs\"" Jul 22 02:26:15.362937 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.362896 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:26:15.494305 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494305 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494619 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494619 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnf8\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494619 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494619 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494619 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494821 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.494821 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.494663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596048 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.595934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596048 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.595989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596048 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596402 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596402 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596402 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596402 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596402 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnf8\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596664 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596664 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596664 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596838 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596935 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596891 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.596995 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.596965 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.599524 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.599500 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.599893 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.599852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.614786 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.614744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.636587 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.636540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnf8\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8\") pod \"e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.649506 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.649466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:15.761697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.761643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:26:15.839101 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.839056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:26:15.845602 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:26:15.845563 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52db2b83_cdc3_4e19_bfb1_632b1276ba93.slice/crio-c76f0d7d57c4f2e4ad4e8633d95b81764e05eac046290a0f5094c7bdfe8577ae WatchSource:0}: Error finding container c76f0d7d57c4f2e4ad4e8633d95b81764e05eac046290a0f5094c7bdfe8577ae: Status 404 returned error can't find the container with id c76f0d7d57c4f2e4ad4e8633d95b81764e05eac046290a0f5094c7bdfe8577ae Jul 22 02:26:15.847922 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.847878 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:15.848027 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.847967 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:15.848027 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:15.847997 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:16.736695 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:16.736645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerStarted","Data":"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6"} Jul 22 02:26:16.737150 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:16.736721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerStarted","Data":"c76f0d7d57c4f2e4ad4e8633d95b81764e05eac046290a0f5094c7bdfe8577ae"} Jul 22 02:26:16.778642 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:16.778576 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podStartSLOduration=1.7785525199999999 podStartE2EDuration="1.77855252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:16.777114917 +0000 UTC m=+2314.457770481" watchObservedRunningTime="2026-07-22 02:26:16.77855252 +0000 UTC m=+2314.459208069" Jul 22 02:26:17.649965 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:17.649913 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:17.655824 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:17.655786 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:17.743313 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:17.743266 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:17.744532 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:17.744502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:25.790624 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:25.790568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:26:33.785201 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:33.785072 2564 patch_prober.go:28] interesting pod/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.135.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 02:26:33.785201 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:33.785177 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 02:26:34.845112 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.844962 2564 generic.go:356] "Generic (PLEG): container finished" podID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerID="6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6" exitCode=0 Jul 22 02:26:34.845112 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.845017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerDied","Data":"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6"} Jul 22 02:26:34.845767 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.845579 2564 scope.go:117] "RemoveContainer" containerID="6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6" Jul 22 02:26:34.847068 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.847005 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:34.847221 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.847195 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:34.847304 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:34.847281 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:35.853308 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:35.853269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerStarted","Data":"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996"} Jul 22 02:26:36.650097 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:36.650043 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:36.650356 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:36.650332 2564 patch_prober.go:28] interesting pod/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" start-of-body= Jul 22 02:26:36.650420 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:36.650384 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" Jul 22 02:26:37.650036 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:37.649975 2564 patch_prober.go:28] interesting pod/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" start-of-body= Jul 22 02:26:37.650467 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:37.650052 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" Jul 22 02:26:38.068549 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:38.068396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:26:38.651162 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:38.651111 2564 patch_prober.go:28] interesting pod/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" start-of-body= Jul 22 02:26:38.651693 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:38.651193 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" Jul 22 02:26:39.650557 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:39.650504 2564 patch_prober.go:28] interesting pod/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" start-of-body= Jul 22 02:26:39.650762 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:39.650565 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.135.0.38:15021/healthz/ready\": dial tcp 10.135.0.38:15021: connect: connection refused" Jul 22 02:26:40.654353 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:40.654319 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:40.654828 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:40.654729 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:26:40.655845 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:26:40.655819 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:27:11.356199 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:27:11.356152 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:27:25.154625 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:27:25.154568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:27:42.764654 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:27:42.764601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:28:01.160152 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:28:01.160101 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:28:18.759542 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:28:18.759501 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:28:34.373127 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:28:34.373073 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:28:53.155727 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:28:53.155677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:29:08.672236 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:29:08.672191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:29:20.463179 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:29:20.463133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:29:27.563361 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:29:27.563319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:29:50.649195 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:29:50.649084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:30:10.764648 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:30:10.764610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:30:31.561532 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:30:31.561490 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:30:44.162012 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:30:44.161972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:30:58.257558 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:30:58.257514 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:31:14.566242 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:31:14.566150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:31:35.766765 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:31:35.766723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:31:49.520107 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:31:49.520069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:32:03.555226 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:03.555178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:32:11.381548 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.381502 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7285-140585246296080"] Jul 22 02:32:11.382069 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.382015 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc6b85f-1bd3-46b3-ba13-988cb0669b36" containerName="istio-proxy" Jul 22 02:32:11.385179 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.385160 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:11.387811 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.387787 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wfg6c\"" Jul 22 02:32:11.392704 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.392677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7285-140585246296080"] Jul 22 02:32:11.555531 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.555483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvbn\" (UniqueName: \"kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn\") pod \"test-curl-7285-140585246296080\" (UID: \"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4\") " pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:11.657223 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.657185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvbn\" (UniqueName: \"kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn\") pod \"test-curl-7285-140585246296080\" (UID: \"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4\") " pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:11.665458 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.665427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvbn\" (UniqueName: \"kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn\") pod \"test-curl-7285-140585246296080\" (UID: \"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4\") " pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:11.696193 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.696139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:11.845835 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.845806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7285-140585246296080"] Jul 22 02:32:11.848723 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:32:11.848691 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ead0dce_bb41_4ea2_9be0_1ff4acd4baf4.slice/crio-5f88f268e1fe86c455d4e37a4a1e15d121488dbf6462dc23b60671315ea71ad3 WatchSource:0}: Error finding container 5f88f268e1fe86c455d4e37a4a1e15d121488dbf6462dc23b60671315ea71ad3: Status 404 returned error can't find the container with id 5f88f268e1fe86c455d4e37a4a1e15d121488dbf6462dc23b60671315ea71ad3 Jul 22 02:32:11.850120 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:11.850098 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:32:12.623458 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:12.623415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7285-140585246296080" event={"ID":"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4","Type":"ContainerStarted","Data":"c809f5497fb0ed55e55737562f6c8f877c280d3e8102c5636c8ed10e291b9e66"} Jul 22 02:32:12.623893 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:12.623472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7285-140585246296080" event={"ID":"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4","Type":"ContainerStarted","Data":"5f88f268e1fe86c455d4e37a4a1e15d121488dbf6462dc23b60671315ea71ad3"} Jul 22 02:32:12.641477 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:12.641423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7285-140585246296080" podStartSLOduration=0.956487137 podStartE2EDuration="1.641407619s" totalImagesPullingTime="684.920482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:32:12.639182367 +0000 UTC m=+2670.319837919" watchObservedRunningTime="2026-07-22 02:32:12.641407619 +0000 UTC m=+2670.322063168" Jul 22 02:32:12.786325 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:12.786233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7285-140585246296080_3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4/test-curl-7285-140585246296080/0.log" Jul 22 02:32:13.629825 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:13.629790 2564 generic.go:356] "Generic (PLEG): container finished" podID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" containerID="c809f5497fb0ed55e55737562f6c8f877c280d3e8102c5636c8ed10e291b9e66" exitCode=0 Jul 22 02:32:13.630263 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:13.629841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7285-140585246296080" event={"ID":"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4","Type":"ContainerDied","Data":"c809f5497fb0ed55e55737562f6c8f877c280d3e8102c5636c8ed10e291b9e66"} Jul 22 02:32:14.780668 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.780631 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:14.818616 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.818575 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7285-140585246296080"] Jul 22 02:32:14.827502 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.827469 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7285-140585246296080"] Jul 22 02:32:14.889573 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.889467 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whvbn\" (UniqueName: \"kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn\") pod \"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4\" (UID: \"3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4\") " Jul 22 02:32:14.892249 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.892217 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn" (OuterVolumeSpecName: "kube-api-access-whvbn") pod "3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" (UID: "3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4"). InnerVolumeSpecName "kube-api-access-whvbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:32:14.991307 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:14.991270 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whvbn\" (UniqueName: \"kubernetes.io/projected/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4-kube-api-access-whvbn\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:32:15.642196 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:15.642167 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:15.642396 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:15.642208 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f88f268e1fe86c455d4e37a4a1e15d121488dbf6462dc23b60671315ea71ad3" Jul 22 02:32:15.652335 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:32:15.652300 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7285-140585246296080\" is forbidden: User \"system:node:ip-10-0-132-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-26.ec2.internal' and this object" podUID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" pod="opendatahub/test-curl-7285-140585246296080" Jul 22 02:32:16.755627 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:16.755593 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" path="/var/lib/kubelet/pods/3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4/volumes" Jul 22 02:32:31.167520 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:31.167475 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:32:54.175340 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:32:54.175249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bwwbw"] Jul 22 02:33:03.191429 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:03.191379 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:33:03.192072 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:03.191606 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" containerID="cri-o://28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996" gracePeriod=30 Jul 22 02:33:08.464690 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.464611 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:33:08.538604 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538565 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.538822 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538651 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.538822 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538697 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcnf8\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.538822 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538762 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539045 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538909 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:33:08.539045 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538933 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539045 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.538981 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539045 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539045 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539026 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539297 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539057 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert\") pod \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\" (UID: \"52db2b83-cdc3-4e19-bfb1-632b1276ba93\") " Jul 22 02:33:08.539297 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539083 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:33:08.539297 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539283 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:33:08.539614 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539568 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:33:08.539697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539671 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-certs\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.539697 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539698 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-workload-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.539906 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.539712 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-credential-socket\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.540060 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.540036 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data" (OuterVolumeSpecName: "istio-data") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:33:08.541143 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.541118 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:33:08.541235 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.541159 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8" (OuterVolumeSpecName: "kube-api-access-qcnf8") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "kube-api-access-qcnf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:33:08.541666 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.541646 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token" (OuterVolumeSpecName: "istio-token") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:33:08.541742 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.541659 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52db2b83-cdc3-4e19-bfb1-632b1276ba93" (UID: "52db2b83-cdc3-4e19-bfb1-632b1276ba93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:33:08.641150 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641105 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-envoy\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.641150 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641144 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-data\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.641150 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641155 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-token\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.641422 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641166 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istiod-ca-cert\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.641422 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641180 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52db2b83-cdc3-4e19-bfb1-632b1276ba93-istio-podinfo\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.641422 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.641192 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcnf8\" (UniqueName: \"kubernetes.io/projected/52db2b83-cdc3-4e19-bfb1-632b1276ba93-kube-api-access-qcnf8\") on node \"ip-10-0-132-26.ec2.internal\" DevicePath \"\"" Jul 22 02:33:08.938484 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.938450 2564 generic.go:356] "Generic (PLEG): container finished" podID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerID="28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996" exitCode=0 Jul 22 02:33:08.938647 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.938503 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" Jul 22 02:33:08.938647 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.938524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerDied","Data":"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996"} Jul 22 02:33:08.938647 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.938569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt" event={"ID":"52db2b83-cdc3-4e19-bfb1-632b1276ba93","Type":"ContainerDied","Data":"c76f0d7d57c4f2e4ad4e8633d95b81764e05eac046290a0f5094c7bdfe8577ae"} Jul 22 02:33:08.938647 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.938591 2564 scope.go:117] "RemoveContainer" containerID="28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996" Jul 22 02:33:08.948093 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.948068 2564 scope.go:117] "RemoveContainer" containerID="6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6" Jul 22 02:33:08.957616 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.957592 2564 scope.go:117] "RemoveContainer" containerID="28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996" Jul 22 02:33:08.957969 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:33:08.957948 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996\": container with ID starting with 28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996 not found: ID does not exist" containerID="28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996" Jul 22 02:33:08.958024 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.957981 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996"} err="failed to get container status \"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996\": rpc error: code = NotFound desc = could not find container \"28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996\": container with ID starting with 28760c180e882a5db0dfde96578f460f090168b59c71321226cdf3a372467996 not found: ID does not exist" Jul 22 02:33:08.958024 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.958000 2564 scope.go:117] "RemoveContainer" containerID="6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6" Jul 22 02:33:08.958251 ip-10-0-132-26 kubenswrapper[2564]: E0722 02:33:08.958230 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6\": container with ID starting with 6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6 not found: ID does not exist" containerID="6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6" Jul 22 02:33:08.958308 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.958257 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6"} err="failed to get container status \"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6\": rpc error: code = NotFound desc = could not find container \"6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6\": container with ID starting with 6b2b3c127bd8fb377652294f0d1fedc01486fe8c5b604457cbdd8cde3b8138f6 not found: ID does not exist" Jul 22 02:33:08.968336 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.968303 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:33:08.982483 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:08.982448 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a73722-openshift-default-8675dcf967-zg9vt"] Jul 22 02:33:10.756120 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:10.756079 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" path="/var/lib/kubelet/pods/52db2b83-cdc3-4e19-bfb1-632b1276ba93/volumes" Jul 22 02:33:11.081094 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:11.081004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-bl8wx_a14cdb74-93c6-49ba-8cc2-1c733e0ad22f/copy-manifests/0.log" Jul 22 02:33:11.100381 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:11.100346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-bl8wx_a14cdb74-93c6-49ba-8cc2-1c733e0ad22f/manager/0.log" Jul 22 02:33:14.156429 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:14.156401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xhrg4_1d75a4a1-fef4-4aef-b149-480fff15b670/kuadrant-console-plugin/0.log" Jul 22 02:33:14.568938 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:14.568818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bwwbw_f01bffe8-67c6-4300-bc66-02cd5cc520e5/limitador/0.log" Jul 22 02:33:15.375690 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:15.375654 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f64fb6dd-ws2mm_468e79a1-1ddb-4d7d-9d78-9d84a8dabe68/kube-auth-proxy/0.log" Jul 22 02:33:15.637349 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:15.637303 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/1.log" Jul 22 02:33:16.641881 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:16.641842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kk7tp_7c85f767-b367-482c-9aa3-8d93d0fdeeeb/main/0.log" Jul 22 02:33:17.047604 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:17.047503 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gv469_e1a2e724-eb1c-4810-a8a6-8f0b15275f98/main/0.log" Jul 22 02:33:26.030518 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:26.030478 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g89k2_e34f5790-2bd6-4705-8140-768ecb509768/global-pull-secret-syncer/0.log" Jul 22 02:33:26.225530 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:26.225484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x6zpb_645102e9-2138-44ba-9fc0-1a739c7d8293/konnectivity-agent/0.log" Jul 22 02:33:26.253359 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:26.253321 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-26.ec2.internal_6f64161d52888b147e761296e566a51e/haproxy/0.log" Jul 22 02:33:31.058502 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:31.058464 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xhrg4_1d75a4a1-fef4-4aef-b149-480fff15b670/kuadrant-console-plugin/0.log" Jul 22 02:33:31.341083 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:31.341053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bwwbw_f01bffe8-67c6-4300-bc66-02cd5cc520e5/limitador/0.log" Jul 22 02:33:33.175719 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.175685 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/alertmanager/0.log" Jul 22 02:33:33.208532 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.208501 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/config-reloader/0.log" Jul 22 02:33:33.247780 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.247752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/kube-rbac-proxy-web/0.log" Jul 22 02:33:33.274083 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.274041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/kube-rbac-proxy/0.log" Jul 22 02:33:33.301614 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.301583 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/kube-rbac-proxy-metric/0.log" Jul 22 02:33:33.335727 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.335696 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/prom-label-proxy/0.log" Jul 22 02:33:33.366160 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.366132 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b7f1da3-4f78-4fbd-84e2-d3c5bfc1ca00/init-config-reloader/0.log" Jul 22 02:33:33.444306 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.444192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2njt4_f9af9114-19bf-4643-962a-85b2c77f137c/kube-state-metrics/0.log" Jul 22 02:33:33.473804 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.473776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2njt4_f9af9114-19bf-4643-962a-85b2c77f137c/kube-rbac-proxy-main/0.log" Jul 22 02:33:33.507289 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.507229 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2njt4_f9af9114-19bf-4643-962a-85b2c77f137c/kube-rbac-proxy-self/0.log" Jul 22 02:33:33.565994 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.565968 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8646447795-cgjl5_3157d79b-5cd9-4718-be33-e9b6361c6714/metrics-server/0.log" Jul 22 02:33:33.630507 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.630472 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hfvtf_501d4db3-5a9a-4efd-85d2-8b3710374315/monitoring-plugin/0.log" Jul 22 02:33:33.866888 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.866779 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wndzc_ffc22457-2096-477f-bae1-0d19171be12f/node-exporter/0.log" Jul 22 02:33:33.897018 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.896991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wndzc_ffc22457-2096-477f-bae1-0d19171be12f/kube-rbac-proxy/0.log" Jul 22 02:33:33.928945 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:33.928919 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wndzc_ffc22457-2096-477f-bae1-0d19171be12f/init-textfile/0.log" Jul 22 02:33:34.109369 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.109338 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-zcbtb_8035ec9a-b0de-45be-9f4d-6dc6ffae1451/kube-rbac-proxy-main/0.log" Jul 22 02:33:34.147080 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.147051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-zcbtb_8035ec9a-b0de-45be-9f4d-6dc6ffae1451/kube-rbac-proxy-self/0.log" Jul 22 02:33:34.177344 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.177302 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-zcbtb_8035ec9a-b0de-45be-9f4d-6dc6ffae1451/openshift-state-metrics/0.log" Jul 22 02:33:34.232027 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.231994 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/prometheus/0.log" Jul 22 02:33:34.261230 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.261179 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/config-reloader/0.log" Jul 22 02:33:34.303883 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.303807 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/thanos-sidecar/0.log" Jul 22 02:33:34.341812 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.341783 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/kube-rbac-proxy-web/0.log" Jul 22 02:33:34.379512 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.379480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/kube-rbac-proxy/0.log" Jul 22 02:33:34.415092 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.415006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/kube-rbac-proxy-thanos/0.log" Jul 22 02:33:34.444955 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.444927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f26f959f-9eff-4343-95ab-d2ca30ad6cb2/init-config-reloader/0.log" Jul 22 02:33:34.483488 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.483023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-l58mv_9569065c-83b0-45d3-be71-462847355c87/prometheus-operator/0.log" Jul 22 02:33:34.523605 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.523522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-l58mv_9569065c-83b0-45d3-be71-462847355c87/kube-rbac-proxy/0.log" Jul 22 02:33:34.555625 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.555596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-784k8_5b3d5e53-aaac-4973-9c1d-54f37a3e11d3/prometheus-operator-admission-webhook/0.log" Jul 22 02:33:34.682401 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.682295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/thanos-query/0.log" Jul 22 02:33:34.707248 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.707201 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/kube-rbac-proxy-web/0.log" Jul 22 02:33:34.745076 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.745047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/kube-rbac-proxy/0.log" Jul 22 02:33:34.787963 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.787918 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/prom-label-proxy/0.log" Jul 22 02:33:34.834018 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.833988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/kube-rbac-proxy-rules/0.log" Jul 22 02:33:34.877190 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:34.877160 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8648784dcb-h5lww_78a111ca-79a8-4b76-9b50-b2f68cec2e12/kube-rbac-proxy-metrics/0.log" Jul 22 02:33:35.693234 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693200 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx"] Jul 22 02:33:35.693622 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693585 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" Jul 22 02:33:35.693622 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693597 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" Jul 22 02:33:35.693622 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693616 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" containerName="test-curl-7285-140585246296080" Jul 22 02:33:35.693622 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693622 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" containerName="test-curl-7285-140585246296080" Jul 22 02:33:35.693754 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693632 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" Jul 22 02:33:35.693754 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693637 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" Jul 22 02:33:35.693754 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693700 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="52db2b83-cdc3-4e19-bfb1-632b1276ba93" containerName="istio-proxy" Jul 22 02:33:35.693754 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.693709 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ead0dce-bb41-4ea2-9be0-1ff4acd4baf4" containerName="test-curl-7285-140585246296080" Jul 22 02:33:35.696756 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.696730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.699474 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.699454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wdk\"/\"kube-root-ca.crt\"" Jul 22 02:33:35.700313 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.700296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-49wdk\"/\"default-dockercfg-fbnjc\"" Jul 22 02:33:35.700586 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.700567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wdk\"/\"openshift-service-ca.crt\"" Jul 22 02:33:35.708884 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.708830 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx"] Jul 22 02:33:35.821573 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.821524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zff7r\" (UniqueName: \"kubernetes.io/projected/f52d5b14-5c06-422a-8936-d7a24bba437d-kube-api-access-zff7r\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.821573 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.821587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-podres\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.821812 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.821610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-proc\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.821812 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.821708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-sys\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.821812 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.821747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-lib-modules\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923173 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-podres\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923173 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-proc\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-sys\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-lib-modules\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zff7r\" (UniqueName: \"kubernetes.io/projected/f52d5b14-5c06-422a-8936-d7a24bba437d-kube-api-access-zff7r\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-proc\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-podres\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-sys\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.923456 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.923434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f52d5b14-5c06-422a-8936-d7a24bba437d-lib-modules\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:35.933359 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:35.933317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zff7r\" (UniqueName: \"kubernetes.io/projected/f52d5b14-5c06-422a-8936-d7a24bba437d-kube-api-access-zff7r\") pod \"perf-node-gather-daemonset-dbbkx\" (UID: \"f52d5b14-5c06-422a-8936-d7a24bba437d\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:36.008587 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:36.008470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:36.188772 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:36.188733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx"] Jul 22 02:33:36.192273 ip-10-0-132-26 kubenswrapper[2564]: W0722 02:33:36.192241 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf52d5b14_5c06_422a_8936_d7a24bba437d.slice/crio-3617f13c133a7ed1e7167f9b8114b14d7a1f5b1721f168a31a1b8b4282bb1443 WatchSource:0}: Error finding container 3617f13c133a7ed1e7167f9b8114b14d7a1f5b1721f168a31a1b8b4282bb1443: Status 404 returned error can't find the container with id 3617f13c133a7ed1e7167f9b8114b14d7a1f5b1721f168a31a1b8b4282bb1443 Jul 22 02:33:37.089768 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:37.089727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" event={"ID":"f52d5b14-5c06-422a-8936-d7a24bba437d","Type":"ContainerStarted","Data":"f5791eb59614186db2b220e118f5c9371046828116f0e8cfcb070fc5544d07ec"} Jul 22 02:33:37.090318 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:37.089790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" event={"ID":"f52d5b14-5c06-422a-8936-d7a24bba437d","Type":"ContainerStarted","Data":"3617f13c133a7ed1e7167f9b8114b14d7a1f5b1721f168a31a1b8b4282bb1443"} Jul 22 02:33:37.090318 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:37.089843 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:37.111075 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:37.111013 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" podStartSLOduration=2.110992973 podStartE2EDuration="2.110992973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:33:37.110276838 +0000 UTC m=+2754.790932388" watchObservedRunningTime="2026-07-22 02:33:37.110992973 +0000 UTC m=+2754.791648560" Jul 22 02:33:37.181186 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:37.181156 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7496c9cc4-p54vl_5ed86b88-925b-4ec6-9128-3cdc9d851eec/console/0.log" Jul 22 02:33:39.096629 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:39.096580 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-779fj_f082bd62-ee51-47a5-9e65-2ff9636edf5c/dns/0.log" Jul 22 02:33:39.158494 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:39.158459 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-779fj_f082bd62-ee51-47a5-9e65-2ff9636edf5c/kube-rbac-proxy/0.log" Jul 22 02:33:39.443845 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:39.443809 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmgp6_3f3d1d24-3406-41f9-a078-53d752d856c8/dns-node-resolver/0.log" Jul 22 02:33:40.218802 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:40.218772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d56zk_17d355d5-f3da-4c24-8c70-c1d3b1e9a675/node-ca/0.log" Jul 22 02:33:41.621026 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:41.620991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f64fb6dd-ws2mm_468e79a1-1ddb-4d7d-9d78-9d84a8dabe68/kube-auth-proxy/0.log" Jul 22 02:33:41.694223 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:41.694178 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/0.log" Jul 22 02:33:41.719570 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:41.719535 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/1.log" Jul 22 02:33:42.715174 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:42.715146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzfrd_f1ca0685-72f9-49c3-918a-90d34c3252dc/serve-healthcheck-canary/0.log" Jul 22 02:33:43.109793 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:43.109761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-dbbkx" Jul 22 02:33:43.539444 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:43.539410 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wmfwx_5087a363-18c5-4a56-a31e-4994e82125ce/kube-rbac-proxy/0.log" Jul 22 02:33:43.568136 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:43.568106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wmfwx_5087a363-18c5-4a56-a31e-4994e82125ce/exporter/0.log" Jul 22 02:33:43.595418 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:43.595390 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wmfwx_5087a363-18c5-4a56-a31e-4994e82125ce/extractor/0.log" Jul 22 02:33:45.985120 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:45.985093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f64fb6dd-ws2mm_468e79a1-1ddb-4d7d-9d78-9d84a8dabe68/kube-auth-proxy/0.log" Jul 22 02:33:46.033333 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:46.033301 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/0.log" Jul 22 02:33:46.057969 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:46.057930 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/1.log" Jul 22 02:33:46.823574 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:46.823537 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-bl8wx_a14cdb74-93c6-49ba-8cc2-1c733e0ad22f/manager/0.log" Jul 22 02:33:46.850305 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:46.850280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-bl8wx_a14cdb74-93c6-49ba-8cc2-1c733e0ad22f/copy-manifests/0.log" Jul 22 02:33:47.850784 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:47.850743 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f64fb6dd-ws2mm_468e79a1-1ddb-4d7d-9d78-9d84a8dabe68/kube-auth-proxy/0.log" Jul 22 02:33:48.014020 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:48.013979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/0.log" Jul 22 02:33:48.040412 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:48.040371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-68nmw_13627a72-d395-4625-820a-8aae268245ce/istio-proxy/1.log" Jul 22 02:33:48.695720 ip-10-0-132-26 kubenswrapper[2564]: I0722 02:33:48.695687 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54d5765bf5-qfk9v_3971c2fb-97b4-48f8-abab-164c88709d00/manager/0.log"