Jul 20 22:22:24.577937 ip-10-0-135-161 systemd[1]: Starting Kubernetes Kubelet... Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.035497 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041330 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041345 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041349 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041352 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041355 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041358 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041363 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.158415 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041366 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.114042 ip-10-0-135-161 systemd[1]: Started Kubernetes Kubelet. Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041368 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041371 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041374 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041378 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041381 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041385 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041388 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041391 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041395 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041398 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041408 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041411 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041414 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041417 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041419 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041422 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041424 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041427 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041430 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.161761 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041434 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041436 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041439 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041441 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041444 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041447 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041449 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041452 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041455 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041458 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041461 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041463 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041466 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041469 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041471 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041474 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041477 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041479 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041483 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.163734 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041489 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041492 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041494 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041497 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041500 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041502 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041505 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041507 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041510 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041512 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041515 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041518 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041520 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041523 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041526 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041528 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041531 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041533 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041536 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041538 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.166208 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041541 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041544 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041546 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041549 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041553 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041556 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041558 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041561 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041564 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041566 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041569 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041571 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041574 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041579 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041583 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041585 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041588 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041591 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041595 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.181004 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041598 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041601 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041603 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041606 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041609 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041611 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041614 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041616 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041619 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041621 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041624 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041626 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041628 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.041631 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042671 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042685 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042690 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042695 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042701 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042711 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.183686 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042716 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042720 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042725 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042729 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042734 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042740 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042744 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042748 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042753 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042757 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042761 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042766 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042775 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042779 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042783 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042788 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042793 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042798 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042802 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042807 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.197152 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042811 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042816 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042823 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042827 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042837 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042842 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042849 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042855 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042862 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042868 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.042873 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043631 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043658 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043666 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043676 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043682 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043692 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043696 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043700 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.215679 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043734 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043739 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043742 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043746 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043751 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043755 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043757 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043760 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043763 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043766 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043769 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043775 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043778 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043780 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043783 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043805 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043808 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043824 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043829 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.368409 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043941 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043945 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043948 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043951 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043954 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043956 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043959 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043962 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043966 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043969 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043972 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043974 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043977 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043980 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043983 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043985 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043988 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043990 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043993 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043996 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.370775 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.043998 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044001 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044003 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044006 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044009 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044011 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044014 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044017 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044021 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044024 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044027 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044029 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044032 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044035 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044037 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044452 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044457 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044460 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044462 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044465 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.372663 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044470 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044472 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044475 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044477 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044480 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044483 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044486 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044488 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044491 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044493 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044496 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044498 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044501 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044504 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044506 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044509 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044511 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044514 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044517 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044519 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.375123 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044524 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044526 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044529 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044531 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044534 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044536 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044539 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044541 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044544 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044547 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044549 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044551 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044555 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044558 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044561 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044563 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044565 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044570 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044573 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044576 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.388927 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044579 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044581 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044583 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044586 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044590 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044593 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044596 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044599 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044601 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044604 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044606 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044609 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044613 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044615 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044617 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044620 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044623 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044626 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044629 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044631 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.393091 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044634 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044636 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044639 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044641 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044663 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044666 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044668 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044671 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044674 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044676 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044679 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044682 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044684 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044687 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044690 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044693 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044695 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044698 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044701 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044705 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.396436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044707 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044710 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044712 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044715 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044720 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044723 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044727 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044730 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044733 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044736 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044739 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044741 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044744 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.044746 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044825 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044833 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044841 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044845 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044850 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044853 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044857 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 22:22:25.400165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044862 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044865 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044868 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044872 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044875 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044878 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044881 2568 flags.go:64] FLAG: --cgroup-root="" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044884 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044887 2568 flags.go:64] FLAG: --client-ca-file="" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044891 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044894 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044898 2568 flags.go:64] FLAG: --cluster-domain="" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044901 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044904 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044907 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044911 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044915 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044918 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044921 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044924 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044927 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044930 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044933 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044936 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 22:22:25.401223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044939 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044944 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044947 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044951 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044954 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044957 2568 flags.go:64] FLAG: --enable-server="true" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044960 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044965 2568 flags.go:64] FLAG: --event-burst="100" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044968 2568 flags.go:64] FLAG: --event-qps="50" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044970 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044973 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044976 2568 flags.go:64] FLAG: --eviction-hard="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044981 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044984 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044987 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044989 2568 flags.go:64] FLAG: --eviction-soft="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044992 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044996 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.044999 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045002 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045005 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045008 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045010 2568 flags.go:64] FLAG: --feature-gates="" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045016 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045019 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 22:22:25.402605 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045022 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045025 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045028 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045031 2568 flags.go:64] FLAG: --help="false" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045033 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045037 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045040 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045043 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045046 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045050 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045055 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045058 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045061 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045064 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045067 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045070 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045073 2568 flags.go:64] FLAG: --kube-reserved="" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045076 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045079 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045082 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045085 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045087 2568 flags.go:64] FLAG: --lock-file="" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045090 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045093 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 22:22:25.403983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045096 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045106 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045110 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045113 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045116 2568 flags.go:64] FLAG: --logging-format="text" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045119 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045125 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045128 2568 flags.go:64] FLAG: --manifest-url="" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045131 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045135 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045138 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045142 2568 flags.go:64] FLAG: --max-pods="110" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045145 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045148 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045151 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045155 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045158 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045160 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045165 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045172 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045175 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045178 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045181 2568 flags.go:64] FLAG: --pod-cidr="" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045184 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 22:22:25.404688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045190 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045193 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045197 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045199 2568 flags.go:64] FLAG: --port="10250" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045202 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045205 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051270693d36bfa65" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045209 2568 flags.go:64] FLAG: --qos-reserved="" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045212 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045215 2568 flags.go:64] FLAG: --register-node="true" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045217 2568 flags.go:64] FLAG: --register-with-taints="" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045221 2568 flags.go:64] FLAG: --registry-burst="10" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045225 2568 flags.go:64] FLAG: --registry-qps="5" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045228 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045230 2568 flags.go:64] FLAG: --reserved-memory="" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045237 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045241 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045244 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045247 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045249 2568 flags.go:64] FLAG: --runonce="false" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045252 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045255 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045258 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045261 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045264 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045267 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045270 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 22:22:25.405615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045274 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045277 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045280 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045283 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045286 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045289 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045291 2568 flags.go:64] FLAG: --system-cgroups="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045294 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045300 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045303 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045306 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045309 2568 flags.go:64] FLAG: --tls-min-version="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045312 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045315 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045318 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045321 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045324 2568 flags.go:64] FLAG: --v="2" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045328 2568 flags.go:64] FLAG: --version="false" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045332 2568 flags.go:64] FLAG: --vmodule="" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045336 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.045339 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045465 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045469 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045473 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.406354 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045476 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045479 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045482 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045484 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045487 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045490 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045493 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045496 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045500 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045502 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045505 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045509 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045512 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045515 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045518 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045521 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045524 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045526 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045529 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.407781 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045532 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045535 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045538 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045541 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045544 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045547 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045550 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045552 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045555 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045558 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045561 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045564 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045566 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045569 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045571 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045574 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045576 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045579 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045582 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045584 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.502108 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045587 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045590 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045593 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045595 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045598 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045600 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045603 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045605 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045608 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045610 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045613 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045638 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045655 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045658 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045661 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045665 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045667 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045670 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045673 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045676 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.502805 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045678 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045681 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045686 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045688 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045691 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045694 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045697 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045699 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045702 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045704 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045707 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045709 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045712 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045715 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045718 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045720 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045723 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045726 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045729 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045731 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.503404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045734 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045736 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045739 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045743 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045746 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045749 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045752 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045755 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045759 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045762 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045765 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045768 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045771 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045774 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045778 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045781 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.503963 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.045783 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.046565 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.055181 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.055198 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.056100 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.056112 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056174 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056179 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056183 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056186 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056189 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056192 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056195 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056197 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056200 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.504437 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056203 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056205 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056208 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056210 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056213 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056216 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056218 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056221 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056223 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056226 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056228 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056232 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056235 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056237 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056240 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056243 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056245 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056248 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056251 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056254 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.504860 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056263 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056267 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056269 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056272 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056275 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056278 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056281 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056283 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056286 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056289 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056291 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056294 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056296 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056299 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056302 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056305 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056308 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056310 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056313 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056315 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.505417 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056318 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056321 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056326 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056329 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056331 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056334 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056336 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056339 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056343 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056346 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056349 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056351 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056354 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056362 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056365 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056368 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056370 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056373 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056377 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056381 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.505961 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056384 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056387 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056389 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056392 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056395 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056397 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056400 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056402 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056405 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056408 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056411 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056414 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056416 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056419 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056423 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056427 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056432 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056435 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056438 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.506632 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056440 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056444 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056447 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056450 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056453 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056456 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056459 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056463 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056466 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056468 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056471 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.056477 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056595 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056600 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056603 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 22:22:25.507173 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056606 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056609 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056613 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056616 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056619 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056621 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056624 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056626 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056629 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056631 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056634 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056636 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056660 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056666 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056669 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056672 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056675 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056678 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056681 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 22:22:25.507636 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056685 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056687 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056690 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056692 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056695 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056698 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056701 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056704 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056707 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056709 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056712 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056714 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056717 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056721 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056724 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056727 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056730 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056733 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056735 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056738 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 22:22:25.508153 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056740 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056743 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056745 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056748 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056750 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056755 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056757 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056760 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056762 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056765 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056768 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056770 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056774 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056777 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056779 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056782 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056784 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056789 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056792 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056796 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 22:22:25.508740 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056798 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056801 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056804 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056807 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056811 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056813 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056816 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056819 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056821 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056824 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056827 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056829 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056832 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056834 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056837 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056840 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056842 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056846 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056849 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056851 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 22:22:25.509267 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056854 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056856 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056859 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056861 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056865 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056868 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056870 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056873 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056875 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056878 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056881 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056883 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056887 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056889 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056892 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056894 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 22:22:25.509876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:25.056897 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.056902 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.057047 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.059486 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.061215 2568 server.go:1019] "Starting client certificate rotation" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.061322 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.061983 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.064094 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.065307 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.073518 2568 log.go:25] "Validated CRI v1 runtime API" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.076010 2568 log.go:25] "Validated CRI v1 image API" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.076734 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 22:22:25.510299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.079410 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8dd49024-c8aa-4930-af40-3c7d41f823e3:/dev/nvme0n1p4 d75ecc2c-dea1-4694-a034-f44745846b27:/dev/nvme0n1p3] Jul 20 22:22:25.510688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.079426 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.085765 2568 manager.go:216] Machine: {Timestamp:2026-07-20 22:22:25.083099446 +0000 UTC m=+0.372784937 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094214 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cfc4b0f11cf98825c30b3e749cc95 SystemUUID:ec2cfc4b-0f11-cf98-825c-30b3e749cc95 BootID:97b350ee-4ecb-4518-ac8d-66c75811e292 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:4c:8d:18:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:4c:8d:18:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:9c:07:b4:dc:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.085874 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.085965 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.089722 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.089758 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.091501 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.091514 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 22:22:25.510761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.091522 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.092337 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.092801 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.094229 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.098887 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099025 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099058 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099072 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099095 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099107 2568 kubelet.go:398] "Adding apiserver pod source" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099119 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099477 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.099494 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.101958 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.104299 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.104326 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105698 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105712 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105717 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105722 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105734 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105743 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105753 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105758 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105765 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105770 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105788 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.105793 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.107682 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.107710 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.113098 2568 server.go:1268] "Started kubelet" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.113147 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.113155 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.113241 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.113256 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.113338 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.113299 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.115836 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.117625 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 20 22:22:25.511075 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.121009 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.121214 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-161.ec2.internal.18c41fa4d28c5fcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-161.ec2.internal,UID:ip-10-0-135-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-161.ec2.internal,},FirstTimestamp:2026-07-20 22:22:25.113071567 +0000 UTC m=+0.402757062,LastTimestamp:2026-07-20 22:22:25.113071567 +0000 UTC m=+0.402757062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-161.ec2.internal,}" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.128222 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.128242 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.128300 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129059 2568 factory.go:55] Registering systemd factory Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129052 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129075 2568 factory.go:223] Registration of the systemd container factory successfully Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129098 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129110 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129276 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129287 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129398 2568 factory.go:153] Registering CRI-O factory Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129409 2568 factory.go:223] Registration of the crio container factory successfully Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129476 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129496 2568 factory.go:103] Registering Raw factory Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129508 2568 manager.go:1196] Started watching for new ooms in manager Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.129871 2568 manager.go:349] Starting recovery of all containers Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.130333 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.130494 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.137859 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jw6t9" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.141451 2568 manager.go:354] Recovery completed Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.143505 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jw6t9" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.146992 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149163 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149201 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149216 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149814 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149823 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149824 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.149838 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.151845 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.151884 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.515190 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.151898 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.153298 2568 policy_none.go:49] "None policy: Start" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.153315 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.153326 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.155318 2568 policy_none.go:47] "Start" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.208022 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.209183 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.209215 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.209236 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.209272 2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.211716 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.228497 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235226 2568 manager.go:337] "Starting Device Plugin manager" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.235255 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235265 2568 server.go:87] "Starting device plugin registration server" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235576 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235591 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235693 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235772 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.235780 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.236317 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.236371 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.309334 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"] Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.309452 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.310486 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.310516 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.310525 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.312826 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.312960 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.312995 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313582 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313606 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313617 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313632 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313670 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.313686 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.316017 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.316048 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.516953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.316914 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.316946 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.316957 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.335956 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.336833 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.336863 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.336877 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.336907 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.336985 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-161.ec2.internal\" not found" node="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.346222 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.346241 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-161.ec2.internal\": node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.354495 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-161.ec2.internal\" not found" node="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.359108 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-161.ec2.internal\" not found" node="ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.378729 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.429967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.429993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.430013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5912a6b56bf9d0fef039c45d63f074fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"5912a6b56bf9d0fef039c45d63f074fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.478937 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530268 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5912a6b56bf9d0fef039c45d63f074fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"5912a6b56bf9d0fef039c45d63f074fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.630886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530356 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.631971 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530359 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7cf0fe5a069ea172db56649ac73db570-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"7cf0fe5a069ea172db56649ac73db570\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.631971 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.530395 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5912a6b56bf9d0fef039c45d63f074fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"5912a6b56bf9d0fef039c45d63f074fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.631971 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.579533 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:25.768487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.659186 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.768487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:25.663170 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:25.768487 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.680433 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:26.952040 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:25.780904 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:27.043272 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:26.962858 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:27.138297 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:27.063327 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:27.141149 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.140872 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 22:22:27.141149 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.141011 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:27.163556 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.169844 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.207887 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.209453 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.209472 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.226537 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.227630 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.231472 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 22:22:27.235872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.235822 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 22:22:27.336352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.252797 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 22:17:26 +0000 UTC" deadline="2027-12-14 06:19:51.432800383 +0000 UTC" Jul 20 22:22:27.336352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.252840 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12271h57m24.179964888s" Jul 20 22:22:27.336352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.252884 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbqgw" Jul 20 22:22:27.336352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.252943 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hbqgw" Jul 20 22:22:27.703439 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:27.629362 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5912a6b56bf9d0fef039c45d63f074fe.slice/crio-49debdceb85f94912886ea51d20e6bcd2990360fd4611871042f403da08eecc1 WatchSource:0}: Error finding container 49debdceb85f94912886ea51d20e6bcd2990360fd4611871042f403da08eecc1: Status 404 returned error can't find the container with id 49debdceb85f94912886ea51d20e6bcd2990360fd4611871042f403da08eecc1 Jul 20 22:22:27.703439 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:27.629596 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf0fe5a069ea172db56649ac73db570.slice/crio-7ad7b52ba8dc0752cc320c9d9bd8bf2b39ceaa05ec2aee8a6877992585599131 WatchSource:0}: Error finding container 7ad7b52ba8dc0752cc320c9d9bd8bf2b39ceaa05ec2aee8a6877992585599131: Status 404 returned error can't find the container with id 7ad7b52ba8dc0752cc320c9d9bd8bf2b39ceaa05ec2aee8a6877992585599131 Jul 20 22:22:27.703439 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.635217 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 22:22:27.834442 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:27.711953 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 22:22:28.181678 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.181639 2568 apiserver.go:52] "Watching apiserver" Jul 20 22:22:28.188818 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.188789 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 22:22:28.189261 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.189208 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-cj8tv","kube-system/konnectivity-agent-r94n7","kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr","openshift-dns/node-resolver-d7vfn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal","openshift-multus/multus-sxwd8","openshift-ovn-kubernetes/ovnkube-node-ptqbj","kube-system/global-pull-secret-syncer-bdhpr","openshift-cluster-node-tuning-operator/tuned-qzchm","openshift-image-registry/node-ca-h4t8p","openshift-multus/multus-additional-cni-plugins-7jjtg","openshift-multus/network-metrics-daemon-v7v9x","openshift-network-diagnostics/network-check-target-r7qll"] Jul 20 22:22:28.191690 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.191666 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.195281 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195107 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.195417 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195395 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 22:22:28.195615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195596 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8k49j\"" Jul 20 22:22:28.195694 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195621 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 22:22:28.195798 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195777 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.196209 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.195868 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:28.196209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.195853 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.198476 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.198340 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:28.198476 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.198405 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:28.200991 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.200637 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.203134 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.203113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.203699 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.203514 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.203699 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.203570 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.203699 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.203518 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 22:22:28.203699 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.203619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-njxxd\"" Jul 20 22:22:28.205437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.205377 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.206159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.205852 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.206159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.205962 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.206308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.206203 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8ljg\"" Jul 20 22:22:28.207739 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.207719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.207840 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.207792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:28.209228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.208882 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.209228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209029 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 22:22:28.209228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209087 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 22:22:28.209462 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209312 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 22:22:28.209855 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209544 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 22:22:28.209855 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209662 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.209855 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.209713 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9bz7\"" Jul 20 22:22:28.214019 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.211583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.214516 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.214481 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 22:22:28.214602 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.214539 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.214860 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.214839 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.215101 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.215080 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8lk9t\"" Jul 20 22:22:28.216533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.216195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.219036 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.219018 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 22:22:28.219704 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.219688 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.219984 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.219967 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 22:22:28.220132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.220114 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r257t\"" Jul 20 22:22:28.221809 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.221791 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8c86\"" Jul 20 22:22:28.223204 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.222751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.224020 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.223647 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.224020 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.223881 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.224899 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.224879 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.225222 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.225201 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 22:22:28.225331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.225209 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 22:22:28.225779 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.225548 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k4rjq\"" Jul 20 22:22:28.225779 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.225647 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 22:22:28.226762 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.226745 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 22:22:28.227476 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.227314 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tpc5w\"" Jul 20 22:22:28.227476 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.227346 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-socket-dir-parent\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-bin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231786 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-netns\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-registration-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.231898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cnibin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-kubelet\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-kubelet\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-iptables-alerter-script\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-system-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88be9f91-2537-4aaa-ba00-a55857967ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cni-binary-copy\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-var-lib-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-env-overrides\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-kubelet-config\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-host-slash\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-netns\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-etc-kubernetes\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6fb\" (UniqueName: \"kubernetes.io/projected/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-kube-api-access-lt6fb\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-bin\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-netd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-config\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cad7217-fd46-4330-9c5e-dbc161db2c99-tmp-dir\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232632 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8eb2ae2b-3744-406a-8b23-f65bee68b036-konnectivity-ca\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-multus\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-hostroot\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-conf-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cad7217-fd46-4330-9c5e-dbc161db2c99-hosts-file\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.232947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-slash\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-systemd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-ovn\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cwvd\" (UniqueName: \"kubernetes.io/projected/88be9f91-2537-4aaa-ba00-a55857967ba6-kube-api-access-2cwvd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-k8s-cni-cncf-io\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-daemon-config\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-etc-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-script-lib\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.232994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-dbus\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9h5r\" (UniqueName: \"kubernetes.io/projected/3211d808-490b-4138-ac34-6c5c1c24ad8f-kube-api-access-f9h5r\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-systemd-units\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.233596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47xmd\" (UniqueName: \"kubernetes.io/projected/20532715-6bae-4a56-85df-4baa1c1d52c1-kube-api-access-47xmd\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-sys-fs\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpnb\" (UniqueName: \"kubernetes.io/projected/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-kube-api-access-hnpnb\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-os-release\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-node-log\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-log-socket\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-device-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-multus-certs\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44st2\" (UniqueName: \"kubernetes.io/projected/2cad7217-fd46-4330-9c5e-dbc161db2c99-kube-api-access-44st2\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-socket-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.234186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.233575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8eb2ae2b-3744-406a-8b23-f65bee68b036-agent-certs\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.255859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.255825 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:17:27 +0000 UTC" deadline="2028-04-03 07:11:51.890981866 +0000 UTC" Jul 20 22:22:28.255990 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.255860 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14936h49m23.635126219s" Jul 20 22:22:28.296141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.296087 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" event={"ID":"5912a6b56bf9d0fef039c45d63f074fe","Type":"ContainerStarted","Data":"49debdceb85f94912886ea51d20e6bcd2990360fd4611871042f403da08eecc1"} Jul 20 22:22:28.297997 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.297940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"7cf0fe5a069ea172db56649ac73db570","Type":"ContainerStarted","Data":"7ad7b52ba8dc0752cc320c9d9bd8bf2b39ceaa05ec2aee8a6877992585599131"} Jul 20 22:22:28.311436 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.311406 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.333939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-multus-certs\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.333991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44st2\" (UniqueName: \"kubernetes.io/projected/2cad7217-fd46-4330-9c5e-dbc161db2c99-kube-api-access-44st2\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-socket-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-multus-certs\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8eb2ae2b-3744-406a-8b23-f65bee68b036-agent-certs\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.334317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334197 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-socket-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-socket-dir-parent\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-bin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-netns\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-registration-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-run\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-socket-dir-parent\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334544 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334559 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-bin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334602 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cnibin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334618 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-netns\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-registration-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cnibin\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-kubelet\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.334786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-kubelet\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334689 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysconfig\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334706 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cnibin\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334719 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-iptables-alerter-script\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-system-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88be9f91-2537-4aaa-ba00-a55857967ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334811 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvg5g\" (UniqueName: \"kubernetes.io/projected/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-kube-api-access-pvg5g\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-kubelet\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cni-binary-copy\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334870 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-kubelet\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-var-lib-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-env-overrides\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-conf\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.335463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.334986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-kubelet-config\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-host-slash\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335034 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-netns\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-etc-kubernetes\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6fb\" (UniqueName: \"kubernetes.io/projected/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-kube-api-access-lt6fb\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-bin\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335143 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-netd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-iptables-alerter-script\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-config\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cad7217-fd46-4330-9c5e-dbc161db2c99-tmp-dir\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335234 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-system-cni-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.336129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335278 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-system-cni-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8eb2ae2b-3744-406a-8b23-f65bee68b036-konnectivity-ca\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-multus\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-hostroot\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-conf-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cad7217-fd46-4330-9c5e-dbc161db2c99-hosts-file\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-slash\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-host\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-systemd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-ovn\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwvd\" (UniqueName: \"kubernetes.io/projected/88be9f91-2537-4aaa-ba00-a55857967ba6-kube-api-access-2cwvd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-systemd\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-os-release\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-k8s-cni-cncf-io\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-daemon-config\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335718 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-etc-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-script-lib\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-sys\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-tuned\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-dbus\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335800 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-cni-binary-copy\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-var-lib-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.337912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335888 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9h5r\" (UniqueName: \"kubernetes.io/projected/3211d808-490b-4138-ac34-6c5c1c24ad8f-kube-api-access-f9h5r\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-systemd-units\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335945 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.335972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47xmd\" (UniqueName: \"kubernetes.io/projected/20532715-6bae-4a56-85df-4baa1c1d52c1-kube-api-access-47xmd\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336001 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-sys-fs\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336057 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-modprobe-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.336070 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-var-lib-kubelet\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336105 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3184e18c-7a22-4b5a-8352-ced764119842-host\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.336155 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:28.836123446 +0000 UTC m=+3.044956360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xkb6\" (UniqueName: \"kubernetes.io/projected/d0dd013d-75a2-47eb-b2bc-f27791ed859f-kube-api-access-9xkb6\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpnb\" (UniqueName: \"kubernetes.io/projected/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-kube-api-access-hnpnb\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-os-release\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.338533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-node-log\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsbmx\" (UniqueName: \"kubernetes.io/projected/3184e18c-7a22-4b5a-8352-ced764119842-kube-api-access-nsbmx\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336952 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-etc-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.336994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-var-lib-cni-multus\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337012 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8eb2ae2b-3744-406a-8b23-f65bee68b036-konnectivity-ca\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337026 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-log-socket\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-device-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-lib-modules\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-tmp\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3184e18c-7a22-4b5a-8352-ced764119842-serviceca\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-kubernetes\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.339183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-hostroot\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337323 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-conf-dir\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337379 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cad7217-fd46-4330-9c5e-dbc161db2c99-hosts-file\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.337367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-multus-daemon-config\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.339196 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-slash\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.339406 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-systemd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.339819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.339457 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-openvswitch\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.340131 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.339931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-env-overrides\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.340131 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.339990 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-run-ovn\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.340304 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340285 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-kubelet-config\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.340367 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-host-slash\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.340423 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-device-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.340481 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-netns\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.340553 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-host-run-k8s-cni-cncf-io\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.340601 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340578 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-etc-kubernetes\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.340648 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340627 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-log-socket\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.340698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.340672 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.341081 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.341151 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:28.841126386 +0000 UTC m=+3.049959306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.341443 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.341515 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-script-lib\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.341517 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3211d808-490b-4138-ac34-6c5c1c24ad8f-sys-fs\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.341903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cad7217-fd46-4330-9c5e-dbc161db2c99-tmp-dir\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.342132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.341979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-netd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342393 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88be9f91-2537-4aaa-ba00-a55857967ba6-ovnkube-config\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.342517 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-host-cni-bin\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.342559 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.342577 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342641 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59eb8778-ed6a-427f-b98d-6ffcc3665bef-dbus\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342685 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-os-release\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-systemd-units\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.342997 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88be9f91-2537-4aaa-ba00-a55857967ba6-node-log\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.343000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88be9f91-2537-4aaa-ba00-a55857967ba6-ovn-node-metrics-cert\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.343090 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:22:28.843071755 +0000 UTC m=+3.051904682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:28.344772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.343148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8eb2ae2b-3744-406a-8b23-f65bee68b036-agent-certs\") pod \"konnectivity-agent-r94n7\" (UID: \"8eb2ae2b-3744-406a-8b23-f65bee68b036\") " pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.345409 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.345387 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44st2\" (UniqueName: \"kubernetes.io/projected/2cad7217-fd46-4330-9c5e-dbc161db2c99-kube-api-access-44st2\") pod \"node-resolver-d7vfn\" (UID: \"2cad7217-fd46-4330-9c5e-dbc161db2c99\") " pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.347923 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.347896 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cwvd\" (UniqueName: \"kubernetes.io/projected/88be9f91-2537-4aaa-ba00-a55857967ba6-kube-api-access-2cwvd\") pod \"ovnkube-node-ptqbj\" (UID: \"88be9f91-2537-4aaa-ba00-a55857967ba6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.352433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.352408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6fb\" (UniqueName: \"kubernetes.io/projected/4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb-kube-api-access-lt6fb\") pod \"multus-sxwd8\" (UID: \"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb\") " pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.354421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.354379 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpnb\" (UniqueName: \"kubernetes.io/projected/4a5e34bb-89e0-4919-8de8-4f60855c6ffc-kube-api-access-hnpnb\") pod \"iptables-alerter-cj8tv\" (UID: \"4a5e34bb-89e0-4919-8de8-4f60855c6ffc\") " pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.355352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.355329 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9h5r\" (UniqueName: \"kubernetes.io/projected/3211d808-490b-4138-ac34-6c5c1c24ad8f-kube-api-access-f9h5r\") pod \"aws-ebs-csi-driver-node-4vxzr\" (UID: \"3211d808-490b-4138-ac34-6c5c1c24ad8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.355449 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.355367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47xmd\" (UniqueName: \"kubernetes.io/projected/20532715-6bae-4a56-85df-4baa1c1d52c1-kube-api-access-47xmd\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.438462 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-host\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-systemd\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-os-release\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438593 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-host\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-sys\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.438666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-tuned\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438673 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-sys\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-modprobe-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-var-lib-kubelet\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3184e18c-7a22-4b5a-8352-ced764119842-host\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xkb6\" (UniqueName: \"kubernetes.io/projected/d0dd013d-75a2-47eb-b2bc-f27791ed859f-kube-api-access-9xkb6\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438822 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438827 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsbmx\" (UniqueName: \"kubernetes.io/projected/3184e18c-7a22-4b5a-8352-ced764119842-kube-api-access-nsbmx\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-lib-modules\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438861 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3184e18c-7a22-4b5a-8352-ced764119842-host\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-tmp\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438891 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-systemd\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.438904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3184e18c-7a22-4b5a-8352-ced764119842-serviceca\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439021 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-lib-modules\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-os-release\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-kubernetes\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439323 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-modprobe-d\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-run\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysconfig\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cnibin\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439421 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-kubernetes\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvg5g\" (UniqueName: \"kubernetes.io/projected/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-kube-api-access-pvg5g\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-conf\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439470 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-run\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.439645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-system-cni-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439610 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysctl-conf\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-sysconfig\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439701 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cnibin\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439708 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3184e18c-7a22-4b5a-8352-ced764119842-serviceca\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439885 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-system-cni-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439877 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.439967 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-var-lib-kubelet\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.440015 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0dd013d-75a2-47eb-b2bc-f27791ed859f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.440300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.440048 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0dd013d-75a2-47eb-b2bc-f27791ed859f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.441653 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.441625 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-etc-tuned\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.442517 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.442461 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-tmp\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.448174 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.448119 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsbmx\" (UniqueName: \"kubernetes.io/projected/3184e18c-7a22-4b5a-8352-ced764119842-kube-api-access-nsbmx\") pod \"node-ca-h4t8p\" (UID: \"3184e18c-7a22-4b5a-8352-ced764119842\") " pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.448969 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.448917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xkb6\" (UniqueName: \"kubernetes.io/projected/d0dd013d-75a2-47eb-b2bc-f27791ed859f-kube-api-access-9xkb6\") pod \"multus-additional-cni-plugins-7jjtg\" (UID: \"d0dd013d-75a2-47eb-b2bc-f27791ed859f\") " pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.451059 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.451010 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvg5g\" (UniqueName: \"kubernetes.io/projected/87d004b1-1a24-4e3b-8bfb-6a3571bfa274-kube-api-access-pvg5g\") pod \"tuned-qzchm\" (UID: \"87d004b1-1a24-4e3b-8bfb-6a3571bfa274\") " pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.504280 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.504238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxwd8" Jul 20 22:22:28.515661 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.515624 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dea5f9c_ce0e_4577_82e0_4dd1f6a7dbeb.slice/crio-c7631cf6057c21bd63fe66542ec818c29d64ff691c5963e1c1e2c880c2bf70ce WatchSource:0}: Error finding container c7631cf6057c21bd63fe66542ec818c29d64ff691c5963e1c1e2c880c2bf70ce: Status 404 returned error can't find the container with id c7631cf6057c21bd63fe66542ec818c29d64ff691c5963e1c1e2c880c2bf70ce Jul 20 22:22:28.518201 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.518097 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" Jul 20 22:22:28.527269 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.527241 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3211d808_490b_4138_ac34_6c5c1c24ad8f.slice/crio-c19a806383e762ecf71dc5a2815d7134c2e284264a12ac5efb1ffa55494eb185 WatchSource:0}: Error finding container c19a806383e762ecf71dc5a2815d7134c2e284264a12ac5efb1ffa55494eb185: Status 404 returned error can't find the container with id c19a806383e762ecf71dc5a2815d7134c2e284264a12ac5efb1ffa55494eb185 Jul 20 22:22:28.529792 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.529772 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7vfn" Jul 20 22:22:28.538657 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.538634 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:28.539989 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.539960 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cad7217_fd46_4330_9c5e_dbc161db2c99.slice/crio-41e80a9e650ec64bed27408504f924b9696b895302dbcea51dde9bd43fc762bf WatchSource:0}: Error finding container 41e80a9e650ec64bed27408504f924b9696b895302dbcea51dde9bd43fc762bf: Status 404 returned error can't find the container with id 41e80a9e650ec64bed27408504f924b9696b895302dbcea51dde9bd43fc762bf Jul 20 22:22:28.545777 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.545755 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cj8tv" Jul 20 22:22:28.547366 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.547345 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88be9f91_2537_4aaa_ba00_a55857967ba6.slice/crio-1a7594ec41dad9a5b94d4e62aff6b4d7834f2b50697d50ea856d24c79ee93d56 WatchSource:0}: Error finding container 1a7594ec41dad9a5b94d4e62aff6b4d7834f2b50697d50ea856d24c79ee93d56: Status 404 returned error can't find the container with id 1a7594ec41dad9a5b94d4e62aff6b4d7834f2b50697d50ea856d24c79ee93d56 Jul 20 22:22:28.556531 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.556489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:28.556837 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.556802 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5e34bb_89e0_4919_8de8_4f60855c6ffc.slice/crio-d480804140e1500826651e8fcdc85125b6dac1e3fa3848bc4adb4341a089b14b WatchSource:0}: Error finding container d480804140e1500826651e8fcdc85125b6dac1e3fa3848bc4adb4341a089b14b: Status 404 returned error can't find the container with id d480804140e1500826651e8fcdc85125b6dac1e3fa3848bc4adb4341a089b14b Jul 20 22:22:28.566683 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.566630 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb2ae2b_3744_406a_8b23_f65bee68b036.slice/crio-f503b29c410b19cc2eae5967eb8c019edaf12d230e4b46083e2b33ecd614fe52 WatchSource:0}: Error finding container f503b29c410b19cc2eae5967eb8c019edaf12d230e4b46083e2b33ecd614fe52: Status 404 returned error can't find the container with id f503b29c410b19cc2eae5967eb8c019edaf12d230e4b46083e2b33ecd614fe52 Jul 20 22:22:28.567661 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.567639 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzchm" Jul 20 22:22:28.575802 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.575776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h4t8p" Jul 20 22:22:28.577783 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.577757 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d004b1_1a24_4e3b_8bfb_6a3571bfa274.slice/crio-b90f34a2c252a5e75eff55221d67eada6510ba59e2a8d919b6aa9da6a36cc9d0 WatchSource:0}: Error finding container b90f34a2c252a5e75eff55221d67eada6510ba59e2a8d919b6aa9da6a36cc9d0: Status 404 returned error can't find the container with id b90f34a2c252a5e75eff55221d67eada6510ba59e2a8d919b6aa9da6a36cc9d0 Jul 20 22:22:28.582868 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.582838 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" Jul 20 22:22:28.586823 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.586797 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3184e18c_7a22_4b5a_8352_ced764119842.slice/crio-62770ab2a4b59cffdce4074b4f5cb7a9ed7f929ea2cbc8c72dc7b2732d135073 WatchSource:0}: Error finding container 62770ab2a4b59cffdce4074b4f5cb7a9ed7f929ea2cbc8c72dc7b2732d135073: Status 404 returned error can't find the container with id 62770ab2a4b59cffdce4074b4f5cb7a9ed7f929ea2cbc8c72dc7b2732d135073 Jul 20 22:22:28.593876 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:22:28.593821 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dd013d_75a2_47eb_b2bc_f27791ed859f.slice/crio-834a840da7a1d493d5725c20cf7f95f70215172246d31f684ea77b9a33948955 WatchSource:0}: Error finding container 834a840da7a1d493d5725c20cf7f95f70215172246d31f684ea77b9a33948955: Status 404 returned error can't find the container with id 834a840da7a1d493d5725c20cf7f95f70215172246d31f684ea77b9a33948955 Jul 20 22:22:28.623035 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.623000 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 22:22:28.842063 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.842028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:28.842224 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.842133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:28.842224 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.842194 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:28.842337 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.842237 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:28.842337 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.842264 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:29.842246935 +0000 UTC m=+4.051079855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:28.842337 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.842280 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:29.842274214 +0000 UTC m=+4.051107124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:28.942933 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:28.942891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:28.943160 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.943010 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:28.943160 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.943034 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:28.943160 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.943043 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:28.943160 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:28.943098 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:22:29.943084833 +0000 UTC m=+4.151917744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:29.256271 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.256161 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:17:27 +0000 UTC" deadline="2027-12-26 04:01:16.878954886 +0000 UTC" Jul 20 22:22:29.256271 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.256215 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12557h38m47.622744922s" Jul 20 22:22:29.301353 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.301315 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4t8p" event={"ID":"3184e18c-7a22-4b5a-8352-ced764119842","Type":"ContainerStarted","Data":"62770ab2a4b59cffdce4074b4f5cb7a9ed7f929ea2cbc8c72dc7b2732d135073"} Jul 20 22:22:29.302551 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.302526 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzchm" event={"ID":"87d004b1-1a24-4e3b-8bfb-6a3571bfa274","Type":"ContainerStarted","Data":"b90f34a2c252a5e75eff55221d67eada6510ba59e2a8d919b6aa9da6a36cc9d0"} Jul 20 22:22:29.303612 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.303585 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r94n7" event={"ID":"8eb2ae2b-3744-406a-8b23-f65bee68b036","Type":"ContainerStarted","Data":"f503b29c410b19cc2eae5967eb8c019edaf12d230e4b46083e2b33ecd614fe52"} Jul 20 22:22:29.304814 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.304781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" event={"ID":"3211d808-490b-4138-ac34-6c5c1c24ad8f","Type":"ContainerStarted","Data":"c19a806383e762ecf71dc5a2815d7134c2e284264a12ac5efb1ffa55494eb185"} Jul 20 22:22:29.305893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.305868 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxwd8" event={"ID":"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb","Type":"ContainerStarted","Data":"c7631cf6057c21bd63fe66542ec818c29d64ff691c5963e1c1e2c880c2bf70ce"} Jul 20 22:22:29.307024 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.306994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerStarted","Data":"834a840da7a1d493d5725c20cf7f95f70215172246d31f684ea77b9a33948955"} Jul 20 22:22:29.308652 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.308631 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cj8tv" event={"ID":"4a5e34bb-89e0-4919-8de8-4f60855c6ffc","Type":"ContainerStarted","Data":"d480804140e1500826651e8fcdc85125b6dac1e3fa3848bc4adb4341a089b14b"} Jul 20 22:22:29.309958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.309899 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"1a7594ec41dad9a5b94d4e62aff6b4d7834f2b50697d50ea856d24c79ee93d56"} Jul 20 22:22:29.311112 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.311089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7vfn" event={"ID":"2cad7217-fd46-4330-9c5e-dbc161db2c99","Type":"ContainerStarted","Data":"41e80a9e650ec64bed27408504f924b9696b895302dbcea51dde9bd43fc762bf"} Jul 20 22:22:29.849234 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.849184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:29.850133 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.849260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:29.850133 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.849436 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:29.850133 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.849515 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:31.84947926 +0000 UTC m=+6.058312172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:29.850133 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.849936 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:29.850133 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.849986 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:31.849970772 +0000 UTC m=+6.058803683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:29.949764 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:29.949719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:29.949974 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.949957 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:29.950044 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.949981 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:29.950044 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.949994 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:29.950157 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:29.950055 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:22:31.950035056 +0000 UTC m=+6.158867967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:30.290702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:30.290833 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:30.291272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:30.291380 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:30.291448 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:30.291606 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:30.291566 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:31.325038 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.324990 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" event={"ID":"5912a6b56bf9d0fef039c45d63f074fe","Type":"ContainerStarted","Data":"0a85e1d0bf40318af48fbcde21e74efa683dd04df277815757f4fc215fd3a626"} Jul 20 22:22:31.337656 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.337622 2568 generic.go:356] "Generic (PLEG): container finished" podID="7cf0fe5a069ea172db56649ac73db570" containerID="3ac9232401565ff6378cb5aec5f78924d6466d171c892160bfcc8314d5aa1f16" exitCode=0 Jul 20 22:22:31.337821 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.337683 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"7cf0fe5a069ea172db56649ac73db570","Type":"ContainerDied","Data":"3ac9232401565ff6378cb5aec5f78924d6466d171c892160bfcc8314d5aa1f16"} Jul 20 22:22:31.360638 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.360583 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" podStartSLOduration=4.360561907 podStartE2EDuration="4.360561907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:31.343244804 +0000 UTC m=+5.552077734" watchObservedRunningTime="2026-07-20 22:22:31.360561907 +0000 UTC m=+5.569394837" Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.866109 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.866176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.866320 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.866382 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:35.866362894 +0000 UTC m=+10.075195807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.866617 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:31.866691 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.866666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:35.866652606 +0000 UTC m=+10.075485515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:31.967226 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:31.967185 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:31.967412 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.967391 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:31.967485 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.967422 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:31.967485 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.967436 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:31.968065 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:31.967653 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:22:35.967478182 +0000 UTC m=+10.176311112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:32.291115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:32.291041 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:32.291284 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:32.291175 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:32.291576 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:32.291557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:32.291679 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:32.291656 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:32.291917 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:32.291794 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:32.291917 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:32.291888 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:32.343519 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:32.343466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"7cf0fe5a069ea172db56649ac73db570","Type":"ContainerStarted","Data":"f7ddab5747eeace5e9b4e0cc31c14400e33f25e328c6b2c2460f0f8bd99f3a2e"} Jul 20 22:22:32.363676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:32.363625 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" podStartSLOduration=5.363605072 podStartE2EDuration="5.363605072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:32.362416659 +0000 UTC m=+6.571249589" watchObservedRunningTime="2026-07-20 22:22:32.363605072 +0000 UTC m=+6.572438000" Jul 20 22:22:34.291318 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:34.291282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:34.291775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:34.291279 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:34.291775 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:34.291439 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:34.291775 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:34.291517 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:34.291775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:34.291282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:34.291775 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:34.291613 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:35.901365 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:35.901330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:35.901852 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:35.901395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:35.901852 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:35.901533 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:35.901852 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:35.901602 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:43.901582948 +0000 UTC m=+18.110415869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:35.901852 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:35.901669 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:35.901852 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:35.901706 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:43.901694142 +0000 UTC m=+18.110527053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:36.002385 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:36.002345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:36.002615 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.002525 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:36.002615 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.002549 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:36.002615 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.002562 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:36.002772 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.002625 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:22:44.002605949 +0000 UTC m=+18.211438859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:36.291475 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:36.291398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:36.291475 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:36.291426 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:36.291475 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:36.291448 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:36.291738 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.291532 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:36.291738 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.291604 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:36.291738 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:36.291666 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:38.290986 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:38.290953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:38.291429 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:38.291082 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:38.291429 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:38.290953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:38.291429 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:38.291186 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:38.291429 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:38.291241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:38.291429 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:38.291304 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:40.291410 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:40.291375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:40.291410 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:40.291406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:40.291950 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:40.291384 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:40.291950 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:40.291535 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:40.291950 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:40.291636 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:40.291950 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:40.291738 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:42.290611 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:42.290574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:42.291059 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:42.290574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:42.291059 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:42.290698 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:42.291059 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:42.290797 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:42.291059 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:42.290590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:42.291059 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:42.290896 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:43.960212 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:43.960164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:43.960745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:43.960231 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:43.960745 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:43.960286 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:43.960745 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:43.960355 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:22:59.960333009 +0000 UTC m=+34.169165916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:43.960745 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:43.960361 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:43.960745 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:43.960413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:59.960396488 +0000 UTC m=+34.169229395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:44.061486 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:44.061412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:44.061662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.061571 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:22:44.061662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.061598 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:22:44.061662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.061609 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:44.061815 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.061663 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:23:00.061644458 +0000 UTC m=+34.270477368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:22:44.290994 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:44.290917 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:44.290994 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:44.290949 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:44.290994 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:44.290919 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:44.291241 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.291039 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:44.291241 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.291174 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:44.291343 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:44.291250 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:46.291596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:46.291556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:46.292122 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:46.291604 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:46.292122 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:46.291683 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:46.292122 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:46.291721 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:46.292122 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:46.291775 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:46.292122 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:46.291846 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:48.291676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.291310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:48.292058 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:48.291800 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:48.292058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.291460 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:48.292058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.291356 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:48.292058 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:48.291902 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:48.292058 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:48.292004 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:48.374541 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.374347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"4c84fb9874b0759dbbd23c32708bf33c2c74e36a0d8a4ee156fc6b5d0574130e"} Jul 20 22:22:48.375839 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.375811 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7vfn" event={"ID":"2cad7217-fd46-4330-9c5e-dbc161db2c99","Type":"ContainerStarted","Data":"707f92736d825470dc47b6a1c1fa5dbd03cb2abeefb40da4575b4e9fdabec4c1"} Jul 20 22:22:48.377336 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.377309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h4t8p" event={"ID":"3184e18c-7a22-4b5a-8352-ced764119842","Type":"ContainerStarted","Data":"348e006f5945c2386d3f1bcf918a30b962e381fa86565effa88d72db80cacd00"} Jul 20 22:22:48.378785 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.378754 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzchm" event={"ID":"87d004b1-1a24-4e3b-8bfb-6a3571bfa274","Type":"ContainerStarted","Data":"fcd1c834f0b15d969afe3beede0bdfdf750b97baa8a9529ecf11016ca033bb2a"} Jul 20 22:22:48.380256 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.380233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r94n7" event={"ID":"8eb2ae2b-3744-406a-8b23-f65bee68b036","Type":"ContainerStarted","Data":"0eba21a6a5b2c7b45e3b97875acc52073f27dae6e4cac8aa6e0ab8607aafd35b"} Jul 20 22:22:48.381736 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.381714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" event={"ID":"3211d808-490b-4138-ac34-6c5c1c24ad8f","Type":"ContainerStarted","Data":"6151c619feb9e0e0ddbf19a97855556ce9b49efc87105b102fa481f56e0718f3"} Jul 20 22:22:48.383035 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.383010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxwd8" event={"ID":"4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb","Type":"ContainerStarted","Data":"bf1771910ec6268b7b6500667ea6c03659e8d2a72231fe8a3e6fd009dd65ca4b"} Jul 20 22:22:48.384635 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.384580 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="df74626f00bc47f4a56fef06dad14698dc12effa243f5aa075c496140e333147" exitCode=0 Jul 20 22:22:48.384635 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.384618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"df74626f00bc47f4a56fef06dad14698dc12effa243f5aa075c496140e333147"} Jul 20 22:22:48.392486 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.392417 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d7vfn" podStartSLOduration=2.948876544 podStartE2EDuration="22.392398193s" totalImagesPullingTime="19.443521649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:48.391706741 +0000 UTC m=+22.600539670" watchObservedRunningTime="2026-07-20 22:22:48.392398193 +0000 UTC m=+22.601231189" Jul 20 22:22:48.406938 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.406894 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r94n7" podStartSLOduration=2.990160081 podStartE2EDuration="22.406879185s" totalImagesPullingTime="19.416719104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:48.406439437 +0000 UTC m=+22.615272386" watchObservedRunningTime="2026-07-20 22:22:48.406879185 +0000 UTC m=+22.615712091" Jul 20 22:22:48.424083 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.424034 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qzchm" podStartSLOduration=2.911006285 podStartE2EDuration="22.424016143s" totalImagesPullingTime="19.513009858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:48.423634981 +0000 UTC m=+22.632467914" watchObservedRunningTime="2026-07-20 22:22:48.424016143 +0000 UTC m=+22.632849073" Jul 20 22:22:48.442465 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.442427 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sxwd8" podStartSLOduration=2.807615701 podStartE2EDuration="22.442412393s" totalImagesPullingTime="19.634796692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:48.442321895 +0000 UTC m=+22.651154857" watchObservedRunningTime="2026-07-20 22:22:48.442412393 +0000 UTC m=+22.651245321" Jul 20 22:22:48.466258 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:48.466207 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h4t8p" podStartSLOduration=2.962185169 podStartE2EDuration="22.466185307s" totalImagesPullingTime="19.504000138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:48.46571305 +0000 UTC m=+22.674546005" watchObservedRunningTime="2026-07-20 22:22:48.466185307 +0000 UTC m=+22.675018237" Jul 20 22:22:49.377723 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.377692 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 22:22:49.389576 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.389540 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" event={"ID":"3211d808-490b-4138-ac34-6c5c1c24ad8f","Type":"ContainerStarted","Data":"40d5ca0b62efc1a92deb5c5c40276f9571e79228251fd00db7ad6cee8abf01d1"} Jul 20 22:22:49.393087 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.393057 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"9ee5230822ddf4417b32f4aaec486aefbc139f97cba5c2c095c960fb30f646a4"} Jul 20 22:22:49.393218 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.393147 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"eff509edc3e6e95682b75579881d408d2d1296357d8379212fab0fbe3d3921d3"} Jul 20 22:22:49.393218 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.393200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"bcb6809b3139442897af59a6a406573f8bfc1cb3800324074e67eeb395c5d649"} Jul 20 22:22:49.393328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.393248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"bd88cfc8332704efeceb0ef5fd839293d4867619df4738ee5c985fdc3dd00e0f"} Jul 20 22:22:49.393328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:49.393297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"508777749d5848da0d4c4bd60b2ef1086c277b0ab780769259dc195a05b20918"} Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.290828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.290875 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.290828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:50.290973 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:50.291066 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:50.291189 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:50.291155 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:50.327057 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.326914 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T22:22:49.377717352Z","UUID":"2bf250dd-99bd-4076-bfd3-1c3154023057","Handler":null,"Name":"","Endpoint":""} Jul 20 22:22:50.328784 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.328749 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 22:22:50.328904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.328794 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 22:22:50.397243 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.397176 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cj8tv" event={"ID":"4a5e34bb-89e0-4919-8de8-4f60855c6ffc","Type":"ContainerStarted","Data":"8d87fd2c8df3589e57614dc8971e2574b449f18dd8eae56f86215a40d3ebfe02"} Jul 20 22:22:50.412941 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:50.412890 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cj8tv" podStartSLOduration=4.87836322 podStartE2EDuration="24.412874565s" totalImagesPullingTime="19.534511345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:50.412634157 +0000 UTC m=+24.621467085" watchObservedRunningTime="2026-07-20 22:22:50.412874565 +0000 UTC m=+24.621707493" Jul 20 22:22:51.400918 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:51.400883 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" event={"ID":"3211d808-490b-4138-ac34-6c5c1c24ad8f","Type":"ContainerStarted","Data":"b1754edb2d45c1c080529638b2f702818e80cf596b96779b9c978614973ec6a3"} Jul 20 22:22:51.407045 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:51.407021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"8b180d7de27ff5cbdc5447b0c60f86924a0f9dc5dc9afb49f5ebadd87d9d2f55"} Jul 20 22:22:51.424029 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:51.423991 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vxzr" podStartSLOduration=3.643061354 podStartE2EDuration="25.423977326s" totalImagesPullingTime="21.780915972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:51.423585409 +0000 UTC m=+25.632418338" watchObservedRunningTime="2026-07-20 22:22:51.423977326 +0000 UTC m=+25.632810254" Jul 20 22:22:52.290431 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:52.290401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:52.290631 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:52.290559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:52.290631 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:52.290611 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:52.290753 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:52.290658 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:52.290753 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:52.290720 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:52.290856 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:52.290806 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:52.319356 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:52.319322 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:52.319826 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:52.319806 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:54.291290 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.291263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:54.292097 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.291298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:54.292097 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.291263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:54.292097 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:54.291425 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:54.292097 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:54.291475 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:54.292097 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:54.291553 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:54.414851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.414806 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerStarted","Data":"bb6ff3621dac2e19dd4fd378078a5c7548fa45d438b1e40769303db74aa90017"} Jul 20 22:22:54.418097 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.418072 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" event={"ID":"88be9f91-2537-4aaa-ba00-a55857967ba6","Type":"ContainerStarted","Data":"8e27d55953c5329d0568c5e4d29ab2fe7755d55d68c6182d19b8f19027930b2c"} Jul 20 22:22:54.418324 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.418310 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:54.418380 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.418360 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:54.433379 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.433222 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:54.468804 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:54.468757 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" podStartSLOduration=8.854994468 podStartE2EDuration="28.468743266s" totalImagesPullingTime="19.613748798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:22:54.468661697 +0000 UTC m=+28.677494647" watchObservedRunningTime="2026-07-20 22:22:54.468743266 +0000 UTC m=+28.677576227" Jul 20 22:22:55.231608 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.231575 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:55.231839 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.231729 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 22:22:55.232130 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.232112 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r94n7" Jul 20 22:22:55.422060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.422027 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="bb6ff3621dac2e19dd4fd378078a5c7548fa45d438b1e40769303db74aa90017" exitCode=0 Jul 20 22:22:55.422451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.422086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"bb6ff3621dac2e19dd4fd378078a5c7548fa45d438b1e40769303db74aa90017"} Jul 20 22:22:55.423192 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.422856 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:55.438316 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:55.438296 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:22:56.292198 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.292164 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:56.292386 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.292246 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:56.292386 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.292287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:56.292386 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.292305 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:56.292557 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.292381 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:56.292557 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.292483 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:56.354686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.354659 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7v9x"] Jul 20 22:22:56.358212 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.358187 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdhpr"] Jul 20 22:22:56.358948 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.358929 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r7qll"] Jul 20 22:22:56.424325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.424297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:56.424733 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.424330 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:56.424733 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:56.424296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:56.424733 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.424425 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:56.424733 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.424545 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:56.424733 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:56.424613 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:57.428722 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:57.428692 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="4cd42b76eb8e080c8785af225dece9881cdc34992af34f1b9c1e8ac83a6b8104" exitCode=0 Jul 20 22:22:57.429138 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:57.428781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"4cd42b76eb8e080c8785af225dece9881cdc34992af34f1b9c1e8ac83a6b8104"} Jul 20 22:22:58.290516 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:58.290468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:58.290701 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:58.290468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:58.290701 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:58.290596 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:22:58.290817 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:58.290692 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:22:58.290817 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:58.290473 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:22:58.290817 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:58.290802 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:22:59.436174 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:59.435934 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="0d393594e95fc12e374e6ffce3ebd5adf451e7e201d653e2eb55c2384e18b51b" exitCode=0 Jul 20 22:22:59.436174 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:59.436000 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"0d393594e95fc12e374e6ffce3ebd5adf451e7e201d653e2eb55c2384e18b51b"} Jul 20 22:22:59.988572 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:59.988531 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:22:59.988785 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:22:59.988595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:22:59.988785 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:59.988709 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:59.988785 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:59.988768 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:31.988751378 +0000 UTC m=+66.197584288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 22:22:59.988921 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:59.988710 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 22:22:59.988921 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:22:59.988874 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret podName:59eb8778-ed6a-427f-b98d-6ffcc3665bef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:31.988853186 +0000 UTC m=+66.197686110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret") pod "global-pull-secret-syncer-bdhpr" (UID: "59eb8778-ed6a-427f-b98d-6ffcc3665bef") : object "kube-system"/"original-pull-secret" not registered Jul 20 22:23:00.089388 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:00.089350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:00.089568 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.089471 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 22:23:00.089568 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.089486 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 22:23:00.089568 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.089512 2568 projected.go:196] Error preparing data for projected volume kube-api-access-xk8s8 for pod openshift-network-diagnostics/network-check-target-r7qll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:23:00.089568 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.089562 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8 podName:494e198d-0cdb-4178-a2e8-2fe371c7e66e nodeName:}" failed. No retries permitted until 2026-07-20 22:23:32.089548603 +0000 UTC m=+66.298381509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk8s8" (UniqueName: "kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8") pod "network-check-target-r7qll" (UID: "494e198d-0cdb-4178-a2e8-2fe371c7e66e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 22:23:00.290919 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:00.290828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:23:00.291094 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:00.290828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:00.291094 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.290965 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdhpr" podUID="59eb8778-ed6a-427f-b98d-6ffcc3665bef" Jul 20 22:23:00.291094 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:00.290828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:23:00.291218 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.291099 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7v9x" podUID="20532715-6bae-4a56-85df-4baa1c1d52c1" Jul 20 22:23:00.291218 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:00.291010 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7qll" podUID="494e198d-0cdb-4178-a2e8-2fe371c7e66e" Jul 20 22:23:01.113818 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.113789 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeReady" Jul 20 22:23:01.114212 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.113916 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 22:23:01.150204 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.150170 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:23:01.153436 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.153415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.157762 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.157684 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 22:23:01.157762 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.157693 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 22:23:01.158191 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.158160 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 22:23:01.158298 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.158189 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-42787\"" Jul 20 22:23:01.163411 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.163388 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 22:23:01.169065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.169042 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qhw9z"] Jul 20 22:23:01.172967 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.172946 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:23:01.173107 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.173083 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.173218 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.173095 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwrf6"] Jul 20 22:23:01.176637 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.176598 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vb99p\"" Jul 20 22:23:01.176732 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.176689 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 22:23:01.176732 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.176716 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 22:23:01.176948 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.176934 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.179350 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.179327 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 22:23:01.179479 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.179335 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 22:23:01.179479 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.179377 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 22:23:01.179479 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.179381 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4d65x\"" Jul 20 22:23:01.184623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.184600 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwrf6"] Jul 20 22:23:01.185464 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.185445 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhw9z"] Jul 20 22:23:01.297779 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20fff44-09ae-4ccb-9657-81176d44e6c0-config-volume\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.297934 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.297934 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.297934 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297918 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.298075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46xh\" (UniqueName: \"kubernetes.io/projected/b865abc4-a59d-4a77-9433-c5da966704b2-kube-api-access-r46xh\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.298075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.298075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.297989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20fff44-09ae-4ccb-9657-81176d44e6c0-tmp-dir\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.298075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.298075 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.298312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.298312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298110 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b865abc4-a59d-4a77-9433-c5da966704b2-cert\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.298312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spzd\" (UniqueName: \"kubernetes.io/projected/b20fff44-09ae-4ccb-9657-81176d44e6c0-kube-api-access-6spzd\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.298312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.298312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.298235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2qmj\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.337261 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.337221 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r94n7_8eb2ae2b-3744-406a-8b23-f65bee68b036/konnectivity-agent/0.log" limit=1024 Jul 20 22:23:01.399319 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20fff44-09ae-4ccb-9657-81176d44e6c0-config-volume\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.399319 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46xh\" (UniqueName: \"kubernetes.io/projected/b865abc4-a59d-4a77-9433-c5da966704b2-kube-api-access-r46xh\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399426 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20fff44-09ae-4ccb-9657-81176d44e6c0-tmp-dir\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.399528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b865abc4-a59d-4a77-9433-c5da966704b2-cert\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spzd\" (UniqueName: \"kubernetes.io/projected/b20fff44-09ae-4ccb-9657-81176d44e6c0-kube-api-access-6spzd\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qmj\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.399866 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.399843 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.399917 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:01.89989626 +0000 UTC m=+36.108729168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20fff44-09ae-4ccb-9657-81176d44e6c0-config-volume\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.399848 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20fff44-09ae-4ccb-9657-81176d44e6c0-tmp-dir\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.400040 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.400057 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:01.400188 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.400108 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:01.900093333 +0000 UTC m=+36.108926253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:01.400532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.400203 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.400593 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.400560 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.404933 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.404907 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.404933 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.404919 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.405100 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.404941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b865abc4-a59d-4a77-9433-c5da966704b2-cert\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.411159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.411128 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.411808 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.411765 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qmj\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.411808 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.411794 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spzd\" (UniqueName: \"kubernetes.io/projected/b20fff44-09ae-4ccb-9657-81176d44e6c0-kube-api-access-6spzd\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.412229 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.412204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46xh\" (UniqueName: \"kubernetes.io/projected/b865abc4-a59d-4a77-9433-c5da966704b2-kube-api-access-r46xh\") pod \"ingress-canary-vwrf6\" (UID: \"b865abc4-a59d-4a77-9433-c5da966704b2\") " pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.442510 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.442474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r94n7_8eb2ae2b-3744-406a-8b23-f65bee68b036/konnectivity-agent/0.log" limit=1024 Jul 20 22:23:01.490648 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.490623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwrf6" Jul 20 22:23:01.638688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.638650 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwrf6"] Jul 20 22:23:01.643779 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:01.643753 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb865abc4_a59d_4a77_9433_c5da966704b2.slice/crio-2efcd385ae920f2c8b63f18ae5663a30f8cb0188401bf9227835fd66fd58964b WatchSource:0}: Error finding container 2efcd385ae920f2c8b63f18ae5663a30f8cb0188401bf9227835fd66fd58964b: Status 404 returned error can't find the container with id 2efcd385ae920f2c8b63f18ae5663a30f8cb0188401bf9227835fd66fd58964b Jul 20 22:23:01.903043 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.903012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:01.903227 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:01.903088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:01.903227 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.903164 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:01.903227 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.903198 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:01.903227 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.903211 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:01.903227 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.903228 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:02.903211866 +0000 UTC m=+37.112044774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:01.903459 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:01.903259 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:02.903242836 +0000 UTC m=+37.112075757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:02.290996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.290915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:02.291827 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.290915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:23:02.291827 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.290915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:23:02.293725 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.293704 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 22:23:02.293852 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.293749 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wpkcl\"" Jul 20 22:23:02.294736 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.294719 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 22:23:02.294842 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.294780 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vv84p\"" Jul 20 22:23:02.294842 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.294796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 22:23:02.294963 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.294718 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 22:23:02.444164 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.444123 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwrf6" event={"ID":"b865abc4-a59d-4a77-9433-c5da966704b2","Type":"ContainerStarted","Data":"2efcd385ae920f2c8b63f18ae5663a30f8cb0188401bf9227835fd66fd58964b"} Jul 20 22:23:02.911295 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.911034 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:02.911339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:02.911176 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:02.911392 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:02.911446 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:04.911427304 +0000 UTC m=+39.120260211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:02.911464 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:02.911537 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:02.911528 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:04.911512288 +0000 UTC m=+39.120345212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:04.927915 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:04.927872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:04.927932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:04.928042 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:04.928102 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:08.928089432 +0000 UTC m=+43.136922338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:04.928044 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:04.928156 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:04.928435 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:04.928226 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:08.928209963 +0000 UTC m=+43.137042873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:05.477964 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:05.477922 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r94n7_8eb2ae2b-3744-406a-8b23-f65bee68b036/konnectivity-agent/0.log" limit=1024 Jul 20 22:23:05.578891 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:05.578806 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r94n7_8eb2ae2b-3744-406a-8b23-f65bee68b036/konnectivity-agent/0.log" limit=1024 Jul 20 22:23:06.453887 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:06.453854 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwrf6" event={"ID":"b865abc4-a59d-4a77-9433-c5da966704b2","Type":"ContainerStarted","Data":"ad1524d0b6e422ece8be407cf5f11c6de84f363cb8bc7fdfbf05e0b58ec69615"} Jul 20 22:23:06.456434 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:06.456400 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="189e7c0f2593dc7bf39f8598d73ec2631d775f9a5e34bb3ee83bcb65bb507508" exitCode=0 Jul 20 22:23:06.456550 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:06.456456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"189e7c0f2593dc7bf39f8598d73ec2631d775f9a5e34bb3ee83bcb65bb507508"} Jul 20 22:23:06.469789 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:06.469737 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwrf6" podStartSLOduration=1.557802213 podStartE2EDuration="5.469724034s" totalImagesPullingTime="3.911921821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:06.468939362 +0000 UTC m=+40.677772292" watchObservedRunningTime="2026-07-20 22:23:06.469724034 +0000 UTC m=+40.678556942" Jul 20 22:23:07.462100 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:07.462061 2568 generic.go:356] "Generic (PLEG): container finished" podID="d0dd013d-75a2-47eb-b2bc-f27791ed859f" containerID="be17240a5c5d092de53edef203871b7e6170203b94ab7ca5530df333acd88e09" exitCode=0 Jul 20 22:23:07.462465 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:07.462138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerDied","Data":"be17240a5c5d092de53edef203871b7e6170203b94ab7ca5530df333acd88e09"} Jul 20 22:23:08.467061 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:08.467026 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" event={"ID":"d0dd013d-75a2-47eb-b2bc-f27791ed859f","Type":"ContainerStarted","Data":"911e9e51184f437cbd67fbc19683846769de3212506393f007b9b666ca8aa1f1"} Jul 20 22:23:08.490707 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:08.490654 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7jjtg" podStartSLOduration=12.722058461 podStartE2EDuration="42.49063922s" totalImagesPullingTime="29.768580759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:08.489231569 +0000 UTC m=+42.698064498" watchObservedRunningTime="2026-07-20 22:23:08.49063922 +0000 UTC m=+42.699472148" Jul 20 22:23:08.957766 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:08.957724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:08.957947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:08.957802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:08.957947 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:08.957896 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:08.957947 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:08.957918 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:08.957947 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:08.957940 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:08.958171 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:08.957989 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:16.957967408 +0000 UTC m=+51.166800331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:08.958171 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:08.958009 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:16.957999444 +0000 UTC m=+51.166832350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:17.012488 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:17.012448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:17.012488 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:17.012515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:17.012975 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:17.012595 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:17.012975 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:17.012614 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:17.012975 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:17.012614 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:17.012975 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:17.012676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:33.012660686 +0000 UTC m=+67.221493594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:17.012975 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:17.012689 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:33.012683273 +0000 UTC m=+67.221516180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:27.443822 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:27.443794 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptqbj" Jul 20 22:23:32.020128 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.020088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:23:32.020562 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.020199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:23:32.022729 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.022710 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 22:23:32.022881 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.022869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 22:23:32.030638 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:32.030616 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 22:23:32.030749 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:32.030699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs podName:20532715-6bae-4a56-85df-4baa1c1d52c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:36.03067849 +0000 UTC m=+130.239511416 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs") pod "network-metrics-daemon-v7v9x" (UID: "20532715-6bae-4a56-85df-4baa1c1d52c1") : secret "metrics-daemon-secret" not found Jul 20 22:23:32.033599 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.033579 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59eb8778-ed6a-427f-b98d-6ffcc3665bef-original-pull-secret\") pod \"global-pull-secret-syncer-bdhpr\" (UID: \"59eb8778-ed6a-427f-b98d-6ffcc3665bef\") " pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:23:32.121229 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.121192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:32.124252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.124234 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 22:23:32.134492 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.134473 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 22:23:32.144905 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.144883 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk8s8\" (UniqueName: \"kubernetes.io/projected/494e198d-0cdb-4178-a2e8-2fe371c7e66e-kube-api-access-xk8s8\") pod \"network-check-target-r7qll\" (UID: \"494e198d-0cdb-4178-a2e8-2fe371c7e66e\") " pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:32.306766 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.306739 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vv84p\"" Jul 20 22:23:32.315010 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.314990 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:32.316235 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.316219 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdhpr" Jul 20 22:23:32.463469 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.463437 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r7qll"] Jul 20 22:23:32.466398 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:32.466374 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494e198d_0cdb_4178_a2e8_2fe371c7e66e.slice/crio-2dc06cc02a2013d607e2e71dd41e5aac0d79da32a6aad19bc8f259c36e3334bb WatchSource:0}: Error finding container 2dc06cc02a2013d607e2e71dd41e5aac0d79da32a6aad19bc8f259c36e3334bb: Status 404 returned error can't find the container with id 2dc06cc02a2013d607e2e71dd41e5aac0d79da32a6aad19bc8f259c36e3334bb Jul 20 22:23:32.471596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.471576 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdhpr"] Jul 20 22:23:32.474976 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:32.474956 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59eb8778_ed6a_427f_b98d_6ffcc3665bef.slice/crio-9e00325456095e3d450f21bede7cd1c2d49fae2ac27f1af9257aac15012ec6eb WatchSource:0}: Error finding container 9e00325456095e3d450f21bede7cd1c2d49fae2ac27f1af9257aac15012ec6eb: Status 404 returned error can't find the container with id 9e00325456095e3d450f21bede7cd1c2d49fae2ac27f1af9257aac15012ec6eb Jul 20 22:23:32.521806 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.521764 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdhpr" event={"ID":"59eb8778-ed6a-427f-b98d-6ffcc3665bef","Type":"ContainerStarted","Data":"9e00325456095e3d450f21bede7cd1c2d49fae2ac27f1af9257aac15012ec6eb"} Jul 20 22:23:32.522761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:32.522737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r7qll" event={"ID":"494e198d-0cdb-4178-a2e8-2fe371c7e66e","Type":"ContainerStarted","Data":"2dc06cc02a2013d607e2e71dd41e5aac0d79da32a6aad19bc8f259c36e3334bb"} Jul 20 22:23:33.027355 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.027316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.027370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:33.027545 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:33.027614 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls podName:b20fff44-09ae-4ccb-9657-81176d44e6c0 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:05.027595158 +0000 UTC m=+99.236428079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls") pod "dns-default-qhw9z" (UID: "b20fff44-09ae-4ccb-9657-81176d44e6c0") : secret "dns-default-metrics-tls" not found Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:33.027663 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:33.027686 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64667d6dc6-wz2xm: secret "image-registry-tls" not found Jul 20 22:23:33.027841 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:33.027738 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls podName:4e4e84b8-5b1f-4cf4-978a-06cc2d88a001 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:05.027722798 +0000 UTC m=+99.236555722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls") pod "image-registry-64667d6dc6-wz2xm" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001") : secret "image-registry-tls" not found Jul 20 22:23:33.753853 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.753820 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zk8ph"] Jul 20 22:23:33.756523 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.756485 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-flxwd"] Jul 20 22:23:33.756671 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.756632 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.758932 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.758910 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.759337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.759315 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 22:23:33.759626 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.759607 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 22:23:33.759722 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.759678 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s2dqb\"" Jul 20 22:23:33.759823 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.759806 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 22:23:33.759952 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.759938 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 22:23:33.761237 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.761220 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 22:23:33.761330 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.761251 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-r8dpq\"" Jul 20 22:23:33.761587 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.761568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 22:23:33.761688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.761638 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 22:23:33.761802 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.761779 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 22:23:33.779977 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.779948 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 22:23:33.780512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.780456 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-flxwd"] Jul 20 22:23:33.781427 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.781409 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 22:23:33.782315 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.782291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zk8ph"] Jul 20 22:23:33.834582 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t469\" (UniqueName: \"kubernetes.io/projected/5840144e-ef60-4fdb-9ab4-63f0754ec0da-kube-api-access-9t469\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.834582 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzxzs\" (UniqueName: \"kubernetes.io/projected/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-kube-api-access-gzxzs\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.834819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-service-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.834819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834706 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-config\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.834819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-tmp\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.834819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-snapshots\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.835058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-serving-cert\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.835058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-trusted-ca\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.835058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.835058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.834881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5840144e-ef60-4fdb-9ab4-63f0754ec0da-serving-cert\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936087 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t469\" (UniqueName: \"kubernetes.io/projected/5840144e-ef60-4fdb-9ab4-63f0754ec0da-kube-api-access-9t469\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936087 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzxzs\" (UniqueName: \"kubernetes.io/projected/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-kube-api-access-gzxzs\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-service-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-config\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-tmp\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-snapshots\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-serving-cert\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-trusted-ca\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.936312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.936718 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.936333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5840144e-ef60-4fdb-9ab4-63f0754ec0da-serving-cert\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.937201 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.937035 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-tmp\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.937493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.937423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5840144e-ef60-4fdb-9ab4-63f0754ec0da-snapshots\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.937493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.937451 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-config\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.937659 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.937643 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-trusted-ca\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.937881 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.937837 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-service-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.938058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.938013 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5840144e-ef60-4fdb-9ab4-63f0754ec0da-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.939966 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.939942 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-serving-cert\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.940067 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.940048 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5840144e-ef60-4fdb-9ab4-63f0754ec0da-serving-cert\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:33.949195 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.949148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzxzs\" (UniqueName: \"kubernetes.io/projected/dcc5d8bd-acce-4a08-9abe-d2f22d383a74-kube-api-access-gzxzs\") pod \"console-operator-565b7b569d-flxwd\" (UID: \"dcc5d8bd-acce-4a08-9abe-d2f22d383a74\") " pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:33.950254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:33.950233 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t469\" (UniqueName: \"kubernetes.io/projected/5840144e-ef60-4fdb-9ab4-63f0754ec0da-kube-api-access-9t469\") pod \"insights-operator-555d9d7885-zk8ph\" (UID: \"5840144e-ef60-4fdb-9ab4-63f0754ec0da\") " pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:34.069539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.069476 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" Jul 20 22:23:34.075899 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.075856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:34.243300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.243235 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zk8ph"] Jul 20 22:23:34.246776 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:34.246735 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5840144e_ef60_4fdb_9ab4_63f0754ec0da.slice/crio-b0d1757634ddab2332d15be58feae3456eb8a559989cdd2bb5f6de1f551622c9 WatchSource:0}: Error finding container b0d1757634ddab2332d15be58feae3456eb8a559989cdd2bb5f6de1f551622c9: Status 404 returned error can't find the container with id b0d1757634ddab2332d15be58feae3456eb8a559989cdd2bb5f6de1f551622c9 Jul 20 22:23:34.265624 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.265585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-flxwd"] Jul 20 22:23:34.268700 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:34.268670 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc5d8bd_acce_4a08_9abe_d2f22d383a74.slice/crio-abdcc52e68628edb2cd092065a6e4e64c80fadd13895019c470a4c0ca263713e WatchSource:0}: Error finding container abdcc52e68628edb2cd092065a6e4e64c80fadd13895019c470a4c0ca263713e: Status 404 returned error can't find the container with id abdcc52e68628edb2cd092065a6e4e64c80fadd13895019c470a4c0ca263713e Jul 20 22:23:34.529270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.529186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" event={"ID":"5840144e-ef60-4fdb-9ab4-63f0754ec0da","Type":"ContainerStarted","Data":"b0d1757634ddab2332d15be58feae3456eb8a559989cdd2bb5f6de1f551622c9"} Jul 20 22:23:34.530150 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:34.530128 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" event={"ID":"dcc5d8bd-acce-4a08-9abe-d2f22d383a74","Type":"ContainerStarted","Data":"abdcc52e68628edb2cd092065a6e4e64c80fadd13895019c470a4c0ca263713e"} Jul 20 22:23:39.544868 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.544838 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/0.log" Jul 20 22:23:39.545341 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.544877 2568 generic.go:356] "Generic (PLEG): container finished" podID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" containerID="a2aea3f5b62fa56c2f311d04ebfa0a34008d917fded2b40b57a3c75214453ae2" exitCode=255 Jul 20 22:23:39.545341 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.544962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" event={"ID":"dcc5d8bd-acce-4a08-9abe-d2f22d383a74","Type":"ContainerDied","Data":"a2aea3f5b62fa56c2f311d04ebfa0a34008d917fded2b40b57a3c75214453ae2"} Jul 20 22:23:39.545341 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.545162 2568 scope.go:117] "RemoveContainer" containerID="a2aea3f5b62fa56c2f311d04ebfa0a34008d917fded2b40b57a3c75214453ae2" Jul 20 22:23:39.546658 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.546630 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdhpr" event={"ID":"59eb8778-ed6a-427f-b98d-6ffcc3665bef","Type":"ContainerStarted","Data":"cfdf537e161797ce885afc8cf68f59fd98dbf336a75cc8de5964a4839f8cbc03"} Jul 20 22:23:39.548105 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.548079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r7qll" event={"ID":"494e198d-0cdb-4178-a2e8-2fe371c7e66e","Type":"ContainerStarted","Data":"3148aa6a1e5b461bc8859c2a7cdbb4b5bfcff19c9bb0bce5d40d14b3a1e38e88"} Jul 20 22:23:39.548211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.548176 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:23:39.549557 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.549536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" event={"ID":"5840144e-ef60-4fdb-9ab4-63f0754ec0da","Type":"ContainerStarted","Data":"00ef21f21bf81e16a1f656df04671cf563b9da75da556e650374fa0a01f8382b"} Jul 20 22:23:39.579864 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.579728 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r7qll" podStartSLOduration=68.344418357 podStartE2EDuration="1m13.579709209s" totalImagesPullingTime="5.235290852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.578760768 +0000 UTC m=+73.787593697" watchObservedRunningTime="2026-07-20 22:23:39.579709209 +0000 UTC m=+73.788542121" Jul 20 22:23:39.595081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.595032 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" podStartSLOduration=2.089998147 podStartE2EDuration="6.595014213s" totalImagesPullingTime="4.505016066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.594907043 +0000 UTC m=+73.803739994" watchObservedRunningTime="2026-07-20 22:23:39.595014213 +0000 UTC m=+73.803847143" Jul 20 22:23:39.610177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:39.610100 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bdhpr" podStartSLOduration=67.340934377 podStartE2EDuration="1m13.61007872s" totalImagesPullingTime="6.269144343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.609196913 +0000 UTC m=+73.818029843" watchObservedRunningTime="2026-07-20 22:23:39.61007872 +0000 UTC m=+73.818911649" Jul 20 22:23:40.058981 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.058941 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4"] Jul 20 22:23:40.061978 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.061954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" Jul 20 22:23:40.065231 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.065211 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wlxtt\"" Jul 20 22:23:40.065559 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.065539 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 22:23:40.065962 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.065948 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 22:23:40.076544 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.076518 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4"] Jul 20 22:23:40.118441 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.118408 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gcnjf"] Jul 20 22:23:40.121545 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.121522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.124546 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.124493 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 22:23:40.124663 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.124572 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ftm7s\"" Jul 20 22:23:40.125230 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.125208 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 22:23:40.143816 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.143787 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcnjf"] Jul 20 22:23:40.182037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.181997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.182037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.182040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktxgb\" (UniqueName: \"kubernetes.io/projected/7625b207-5003-4b35-81a8-1ceb34787057-kube-api-access-ktxgb\") pod \"migrator-7cc9c7ffd7-jdnd4\" (UID: \"7625b207-5003-4b35-81a8-1ceb34787057\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" Jul 20 22:23:40.182278 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.182127 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.182278 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.182163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7f28\" (UniqueName: \"kubernetes.io/projected/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-api-access-r7f28\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.182278 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.182231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-data-volume\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.182412 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.182306 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-crio-socket\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7f28\" (UniqueName: \"kubernetes.io/projected/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-api-access-r7f28\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-data-volume\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283799 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.283619 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 22:23:40.283799 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.283690 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:40.783673525 +0000 UTC m=+74.992506446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : configmap "kube-rbac-proxy" not found Jul 20 22:23:40.283799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-crio-socket\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktxgb\" (UniqueName: \"kubernetes.io/projected/7625b207-5003-4b35-81a8-1ceb34787057-kube-api-access-ktxgb\") pod \"migrator-7cc9c7ffd7-jdnd4\" (UID: \"7625b207-5003-4b35-81a8-1ceb34787057\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.283889 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283901 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-data-volume\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.283806 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-crio-socket\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.283989 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.283949 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:40.783933362 +0000 UTC m=+74.992766274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:40.296034 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.295999 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7f28\" (UniqueName: \"kubernetes.io/projected/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-api-access-r7f28\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.296159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.296135 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktxgb\" (UniqueName: \"kubernetes.io/projected/7625b207-5003-4b35-81a8-1ceb34787057-kube-api-access-ktxgb\") pod \"migrator-7cc9c7ffd7-jdnd4\" (UID: \"7625b207-5003-4b35-81a8-1ceb34787057\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" Jul 20 22:23:40.370812 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.370727 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" Jul 20 22:23:40.491442 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.491408 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4"] Jul 20 22:23:40.494585 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:40.494554 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7625b207_5003_4b35_81a8_1ceb34787057.slice/crio-aa39e3c93a855eef44cf013d857e815f29789696781ca2911fa99bd6f35e6374 WatchSource:0}: Error finding container aa39e3c93a855eef44cf013d857e815f29789696781ca2911fa99bd6f35e6374: Status 404 returned error can't find the container with id aa39e3c93a855eef44cf013d857e815f29789696781ca2911fa99bd6f35e6374 Jul 20 22:23:40.553901 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.553872 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/1.log" Jul 20 22:23:40.554284 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.554265 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/0.log" Jul 20 22:23:40.554328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.554296 2568 generic.go:356] "Generic (PLEG): container finished" podID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" exitCode=255 Jul 20 22:23:40.554419 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.554386 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" event={"ID":"dcc5d8bd-acce-4a08-9abe-d2f22d383a74","Type":"ContainerDied","Data":"56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8"} Jul 20 22:23:40.554579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.554442 2568 scope.go:117] "RemoveContainer" containerID="a2aea3f5b62fa56c2f311d04ebfa0a34008d917fded2b40b57a3c75214453ae2" Jul 20 22:23:40.554730 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.554711 2568 scope.go:117] "RemoveContainer" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" Jul 20 22:23:40.554943 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.554923 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:23:40.555681 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.555567 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" event={"ID":"7625b207-5003-4b35-81a8-1ceb34787057","Type":"ContainerStarted","Data":"aa39e3c93a855eef44cf013d857e815f29789696781ca2911fa99bd6f35e6374"} Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.787933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:40.788088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.788243 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.788314 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:41.788294896 +0000 UTC m=+75.997127823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.788826 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 22:23:40.790837 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:40.788886 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:41.788870373 +0000 UTC m=+75.997703294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : configmap "kube-rbac-proxy" not found Jul 20 22:23:41.562311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:41.562272 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" event={"ID":"7625b207-5003-4b35-81a8-1ceb34787057","Type":"ContainerStarted","Data":"6b691987ff89a2cf81485403d46db7363e5a467dff0bae3b455e97d031427fbc"} Jul 20 22:23:41.563839 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:41.563815 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/1.log" Jul 20 22:23:41.564158 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:41.564141 2568 scope.go:117] "RemoveContainer" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" Jul 20 22:23:41.564351 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:41.564332 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:23:41.795601 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:41.795564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:41.795761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:41.795625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:41.795761 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:41.795715 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:41.795830 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:41.795756 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 22:23:41.795867 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:41.795769 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:43.795754941 +0000 UTC m=+78.004587851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:41.795867 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:41.795861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:43.795845083 +0000 UTC m=+78.004677995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : configmap "kube-rbac-proxy" not found Jul 20 22:23:42.513165 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.513136 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7vfn_2cad7217-fd46-4330-9c5e-dbc161db2c99/dns-node-resolver/0.log" Jul 20 22:23:42.568058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.568023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" event={"ID":"7625b207-5003-4b35-81a8-1ceb34787057","Type":"ContainerStarted","Data":"1c4d24a08e8adf4741b7f9f051688d1642ac1ffd36f407e1e6b306a3f501f53a"} Jul 20 22:23:42.590420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.590367 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jdnd4" podStartSLOduration=1.612897919 podStartE2EDuration="2.5903522s" totalImagesPullingTime="977.454281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:42.588731694 +0000 UTC m=+76.797564622" watchObservedRunningTime="2026-07-20 22:23:42.5903522 +0000 UTC m=+76.799185128" Jul 20 22:23:42.868953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.868913 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-xgpnn"] Jul 20 22:23:42.871874 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.871856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:42.874396 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.874367 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 22:23:42.875029 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.875007 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 22:23:42.875141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.875056 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 22:23:42.875141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.875084 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 22:23:42.875228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.875155 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hqccc\"" Jul 20 22:23:42.883480 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:42.883460 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-xgpnn"] Jul 20 22:23:43.004880 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.004839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-cabundle\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.004880 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.004885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-key\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.005101 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.005032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwk4d\" (UniqueName: \"kubernetes.io/projected/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-kube-api-access-zwk4d\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.105575 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.105542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwk4d\" (UniqueName: \"kubernetes.io/projected/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-kube-api-access-zwk4d\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.105672 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.105597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-cabundle\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.105672 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.105618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-key\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.106244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.106217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-cabundle\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.107921 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.107903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-signing-key\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.114690 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.114669 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwk4d\" (UniqueName: \"kubernetes.io/projected/d6f38d3f-7f7c-4d74-8040-ed4a5540c640-kube-api-access-zwk4d\") pod \"service-ca-58598695f7-xgpnn\" (UID: \"d6f38d3f-7f7c-4d74-8040-ed4a5540c640\") " pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.181069 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.180990 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-xgpnn" Jul 20 22:23:43.305736 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.305591 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-xgpnn"] Jul 20 22:23:43.310692 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:23:43.310663 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f38d3f_7f7c_4d74_8040_ed4a5540c640.slice/crio-e0284b1a9c1c09367d699b1a6d5eb66ba8371913292957b476329fa1eb8597e8 WatchSource:0}: Error finding container e0284b1a9c1c09367d699b1a6d5eb66ba8371913292957b476329fa1eb8597e8: Status 404 returned error can't find the container with id e0284b1a9c1c09367d699b1a6d5eb66ba8371913292957b476329fa1eb8597e8 Jul 20 22:23:43.572417 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.572381 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-xgpnn" event={"ID":"d6f38d3f-7f7c-4d74-8040-ed4a5540c640","Type":"ContainerStarted","Data":"e0284b1a9c1c09367d699b1a6d5eb66ba8371913292957b476329fa1eb8597e8"} Jul 20 22:23:43.709045 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.709012 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4t8p_3184e18c-7a22-4b5a-8352-ced764119842/node-ca/0.log" Jul 20 22:23:43.811718 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.811672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:43.811906 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:43.811731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:43.811906 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:43.811830 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:43.811906 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:43.811832 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 22:23:43.812063 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:43.811910 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:47.811889697 +0000 UTC m=+82.020722617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:43.812063 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:43.811956 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:47.811934906 +0000 UTC m=+82.020767829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : configmap "kube-rbac-proxy" not found Jul 20 22:23:44.076755 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.076721 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:44.076926 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.076782 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:23:44.077249 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.077227 2568 scope.go:117] "RemoveContainer" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" Jul 20 22:23:44.077433 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:44.077402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:23:44.311081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.311050 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwrf6_b865abc4-a59d-4a77-9433-c5da966704b2/serve-healthcheck-canary/0.log" Jul 20 22:23:44.510602 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.510512 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jdnd4_7625b207-5003-4b35-81a8-1ceb34787057/migrator/0.log" Jul 20 22:23:44.709742 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:44.709710 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jdnd4_7625b207-5003-4b35-81a8-1ceb34787057/graceful-termination/0.log" Jul 20 22:23:45.580329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:45.580291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-xgpnn" event={"ID":"d6f38d3f-7f7c-4d74-8040-ed4a5540c640","Type":"ContainerStarted","Data":"1cc6583c7c1a5455e144f9150acafa981fcebe845f9f951c9ebec7d05501ef13"} Jul 20 22:23:45.613707 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:45.613657 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-xgpnn" podStartSLOduration=1.860505243 podStartE2EDuration="3.613641929s" totalImagesPullingTime="1.753136686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:45.613086262 +0000 UTC m=+79.821919192" watchObservedRunningTime="2026-07-20 22:23:45.613641929 +0000 UTC m=+79.822474857" Jul 20 22:23:47.843209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:47.843175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:47.843662 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:47.843223 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:47.843662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:47.843319 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:47.843662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:47.843385 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:55.843370116 +0000 UTC m=+90.052203023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:47.843662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:47.843322 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 22:23:47.843662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:47.843454 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:23:55.843441702 +0000 UTC m=+90.052274609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : configmap "kube-rbac-proxy" not found Jul 20 22:23:55.290729 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.290699 2568 scope.go:117] "RemoveContainer" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" Jul 20 22:23:55.612460 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.612431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:23:55.612832 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.612817 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/1.log" Jul 20 22:23:55.612892 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.612852 2568 generic.go:356] "Generic (PLEG): container finished" podID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" containerID="9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062" exitCode=255 Jul 20 22:23:55.612926 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.612892 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" event={"ID":"dcc5d8bd-acce-4a08-9abe-d2f22d383a74","Type":"ContainerDied","Data":"9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062"} Jul 20 22:23:55.612959 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.612947 2568 scope.go:117] "RemoveContainer" containerID="56cf8de3606fb0aa673cdc681e4eb3e42a0b1e367c314c09934d1dc2f5ad8ff8" Jul 20 22:23:55.613253 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.613238 2568 scope.go:117] "RemoveContainer" containerID="9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062" Jul 20 22:23:55.613431 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:55.613414 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:23:55.914879 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.914773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:55.914879 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.914835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:55.915068 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:55.914933 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 22:23:55.915068 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:23:55.914999 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls podName:5b57b631-5b04-4b6d-bb24-6d68c7c58fef nodeName:}" failed. No retries permitted until 2026-07-20 22:24:11.914984167 +0000 UTC m=+106.123817074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcnjf" (UID: "5b57b631-5b04-4b6d-bb24-6d68c7c58fef") : secret "insights-runtime-extractor-tls" not found Jul 20 22:23:55.915337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:55.915321 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:23:56.616903 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:23:56.616874 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:24:04.076420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.076380 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:24:04.076955 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.076445 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:24:04.076955 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.076829 2568 scope.go:117] "RemoveContainer" containerID="9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062" Jul 20 22:24:04.077071 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:24:04.077012 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:24:04.760629 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.760585 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh"] Jul 20 22:24:04.764771 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.764745 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l"] Jul 20 22:24:04.764913 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.764861 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.767623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.767596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.767751 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.767598 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 22:24:04.768421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.768404 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 22:24:04.768471 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.768445 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 22:24:04.768728 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.768710 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5vhvx\"" Jul 20 22:24:04.768811 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.768713 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 22:24:04.770004 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.769985 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 22:24:04.770518 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.770478 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb"] Jul 20 22:24:04.770623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.770610 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lrcz6\"" Jul 20 22:24:04.770747 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.770722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 22:24:04.773269 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.773250 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.774135 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.774115 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh"] Jul 20 22:24:04.775591 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.775571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 20 22:24:04.776806 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.776783 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l"] Jul 20 22:24:04.781969 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.781949 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb"] Jul 20 22:24:04.886123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/48c86637-2949-4721-a47d-28542394c2cb-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.886123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ecf805-35f5-4d79-88bc-ed9a5069ad37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.886334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886160 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2936fd0f-8938-4b40-90a4-4402d1611ad8-tmp\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.886334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48c86637-2949-4721-a47d-28542394c2cb-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.886334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2936fd0f-8938-4b40-90a4-4402d1611ad8-klusterlet-config\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.886334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886273 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62qf5\" (UniqueName: \"kubernetes.io/projected/2936fd0f-8938-4b40-90a4-4402d1611ad8-kube-api-access-62qf5\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.886334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.886330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwqn\" (UniqueName: \"kubernetes.io/projected/94ecf805-35f5-4d79-88bc-ed9a5069ad37-kube-api-access-ztwqn\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.986897 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.986853 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwqn\" (UniqueName: \"kubernetes.io/projected/94ecf805-35f5-4d79-88bc-ed9a5069ad37-kube-api-access-ztwqn\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.986924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/48c86637-2949-4721-a47d-28542394c2cb-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.986950 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ecf805-35f5-4d79-88bc-ed9a5069ad37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.986981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2936fd0f-8938-4b40-90a4-4402d1611ad8-tmp\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.987016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48c86637-2949-4721-a47d-28542394c2cb-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.987046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2936fd0f-8938-4b40-90a4-4402d1611ad8-klusterlet-config\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.987079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.987071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62qf5\" (UniqueName: \"kubernetes.io/projected/2936fd0f-8938-4b40-90a4-4402d1611ad8-kube-api-access-62qf5\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.987469 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.987434 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2936fd0f-8938-4b40-90a4-4402d1611ad8-tmp\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:04.987769 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.987744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/48c86637-2949-4721-a47d-28542394c2cb-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.989665 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.989645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48c86637-2949-4721-a47d-28542394c2cb-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-knv8l\" (UID: \"48c86637-2949-4721-a47d-28542394c2cb\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:04.989665 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.989663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ecf805-35f5-4d79-88bc-ed9a5069ad37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:04.989829 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.989702 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2936fd0f-8938-4b40-90a4-4402d1611ad8-klusterlet-config\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:05.000028 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:04.999994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwqn\" (UniqueName: \"kubernetes.io/projected/94ecf805-35f5-4d79-88bc-ed9a5069ad37-kube-api-access-ztwqn\") pod \"managed-serviceaccount-addon-agent-64fc5cdb98-nnclh\" (UID: \"94ecf805-35f5-4d79-88bc-ed9a5069ad37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:05.001205 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.001180 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62qf5\" (UniqueName: \"kubernetes.io/projected/2936fd0f-8938-4b40-90a4-4402d1611ad8-kube-api-access-62qf5\") pod \"klusterlet-addon-workmgr-789dcfbb94-9r9hb\" (UID: \"2936fd0f-8938-4b40-90a4-4402d1611ad8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:05.081393 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.081360 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" Jul 20 22:24:05.087774 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.087744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:05.087894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.087784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:24:05.087894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.087785 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" Jul 20 22:24:05.090114 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.090089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"image-registry-64667d6dc6-wz2xm\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:05.090228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.090210 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20fff44-09ae-4ccb-9657-81176d44e6c0-metrics-tls\") pod \"dns-default-qhw9z\" (UID: \"b20fff44-09ae-4ccb-9657-81176d44e6c0\") " pod="openshift-dns/dns-default-qhw9z" Jul 20 22:24:05.093810 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.093791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:05.243285 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.243172 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh"] Jul 20 22:24:05.245836 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:05.245801 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ecf805_35f5_4d79_88bc_ed9a5069ad37.slice/crio-a60c4017c39b6c53d351fa51f5dc56473a7dbb1217c52925e114022236c6212b WatchSource:0}: Error finding container a60c4017c39b6c53d351fa51f5dc56473a7dbb1217c52925e114022236c6212b: Status 404 returned error can't find the container with id a60c4017c39b6c53d351fa51f5dc56473a7dbb1217c52925e114022236c6212b Jul 20 22:24:05.369856 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.369775 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-42787\"" Jul 20 22:24:05.375031 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.375004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:05.387319 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.387300 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vb99p\"" Jul 20 22:24:05.395392 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.395365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhw9z" Jul 20 22:24:05.459908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.459747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l"] Jul 20 22:24:05.466345 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.466266 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb"] Jul 20 22:24:05.470914 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:05.470889 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2936fd0f_8938_4b40_90a4_4402d1611ad8.slice/crio-4a4c2ef1b89c36706ff47c61d5c104e31197b8e67c781a435bded5875d79784c WatchSource:0}: Error finding container 4a4c2ef1b89c36706ff47c61d5c104e31197b8e67c781a435bded5875d79784c: Status 404 returned error can't find the container with id 4a4c2ef1b89c36706ff47c61d5c104e31197b8e67c781a435bded5875d79784c Jul 20 22:24:05.519912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.519883 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:24:05.522748 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:05.522719 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4e84b8_5b1f_4cf4_978a_06cc2d88a001.slice/crio-1995dc5811fd5e877eb18466dfe846145a57df527e6118de9e339c82f0504460 WatchSource:0}: Error finding container 1995dc5811fd5e877eb18466dfe846145a57df527e6118de9e339c82f0504460: Status 404 returned error can't find the container with id 1995dc5811fd5e877eb18466dfe846145a57df527e6118de9e339c82f0504460 Jul 20 22:24:05.542493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.542470 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhw9z"] Jul 20 22:24:05.552383 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:05.552359 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20fff44_09ae_4ccb_9657_81176d44e6c0.slice/crio-d18b77f28c6e073a63222460b35dad8aa0ec59d3f09073bf521c0e243e83a28a WatchSource:0}: Error finding container d18b77f28c6e073a63222460b35dad8aa0ec59d3f09073bf521c0e243e83a28a: Status 404 returned error can't find the container with id d18b77f28c6e073a63222460b35dad8aa0ec59d3f09073bf521c0e243e83a28a Jul 20 22:24:05.645579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.645541 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" event={"ID":"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001","Type":"ContainerStarted","Data":"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87"} Jul 20 22:24:05.645734 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.645593 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" event={"ID":"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001","Type":"ContainerStarted","Data":"1995dc5811fd5e877eb18466dfe846145a57df527e6118de9e339c82f0504460"} Jul 20 22:24:05.645734 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.645638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:05.646752 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.646732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" event={"ID":"2936fd0f-8938-4b40-90a4-4402d1611ad8","Type":"ContainerStarted","Data":"4a4c2ef1b89c36706ff47c61d5c104e31197b8e67c781a435bded5875d79784c"} Jul 20 22:24:05.647865 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.647836 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" event={"ID":"48c86637-2949-4721-a47d-28542394c2cb","Type":"ContainerStarted","Data":"9f44b79b6653c56661cab08626af985e998cf0198c84529e2ed3d5cf4fcc1b78"} Jul 20 22:24:05.648887 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.648864 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" event={"ID":"94ecf805-35f5-4d79-88bc-ed9a5069ad37","Type":"ContainerStarted","Data":"a60c4017c39b6c53d351fa51f5dc56473a7dbb1217c52925e114022236c6212b"} Jul 20 22:24:05.649922 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.649905 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhw9z" event={"ID":"b20fff44-09ae-4ccb-9657-81176d44e6c0","Type":"ContainerStarted","Data":"d18b77f28c6e073a63222460b35dad8aa0ec59d3f09073bf521c0e243e83a28a"} Jul 20 22:24:05.671526 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:05.671467 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" podStartSLOduration=98.671454778 podStartE2EDuration="1m38.671454778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:05.670695451 +0000 UTC m=+99.879528405" watchObservedRunningTime="2026-07-20 22:24:05.671454778 +0000 UTC m=+99.880287706" Jul 20 22:24:10.558470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:10.558429 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r7qll" Jul 20 22:24:11.672455 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.672418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" event={"ID":"2936fd0f-8938-4b40-90a4-4402d1611ad8","Type":"ContainerStarted","Data":"f8635e3d8adb6e524b96bc77086d1e9b17059d277da90ebb4ad1d533ac6dbe84"} Jul 20 22:24:11.672981 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.672642 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:11.674072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.674047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" event={"ID":"48c86637-2949-4721-a47d-28542394c2cb","Type":"ContainerStarted","Data":"d93ff8d99899f2a5ba206dedadbd371fc8dafbe01c2edbdfe7cc6e426847cd58"} Jul 20 22:24:11.674446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.674427 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" Jul 20 22:24:11.675493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.675465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" event={"ID":"94ecf805-35f5-4d79-88bc-ed9a5069ad37","Type":"ContainerStarted","Data":"0da056059e1bc2f5e0ff29986811ba3e27f443a26cca4064451170f06fe90a8b"} Jul 20 22:24:11.680728 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.680702 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhw9z" event={"ID":"b20fff44-09ae-4ccb-9657-81176d44e6c0","Type":"ContainerStarted","Data":"5dc6bd7e26a3f746bb10d117b90dce629c5b46d6deaabb509db8ce536072869a"} Jul 20 22:24:11.680812 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.680769 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhw9z" event={"ID":"b20fff44-09ae-4ccb-9657-81176d44e6c0","Type":"ContainerStarted","Data":"c58a1eb783e8ed4dd25773ef0010e5943fc14c706bc9e1d79080cab11c5e2038"} Jul 20 22:24:11.680812 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.680790 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qhw9z" Jul 20 22:24:11.692488 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.692443 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789dcfbb94-9r9hb" podStartSLOduration=2.376008078 podStartE2EDuration="7.69243263s" totalImagesPullingTime="5.316424552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:11.691534369 +0000 UTC m=+105.900367317" watchObservedRunningTime="2026-07-20 22:24:11.69243263 +0000 UTC m=+105.901265558" Jul 20 22:24:11.706465 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.706425 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-knv8l" podStartSLOduration=6.092857782 podStartE2EDuration="7.706414825s" totalImagesPullingTime="1.613557043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:11.706060043 +0000 UTC m=+105.914892998" watchObservedRunningTime="2026-07-20 22:24:11.706414825 +0000 UTC m=+105.915247789" Jul 20 22:24:11.721318 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.721271 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64fc5cdb98-nnclh" podStartSLOduration=2.196068596 podStartE2EDuration="7.721258637s" totalImagesPullingTime="5.525190041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:11.721055069 +0000 UTC m=+105.929887997" watchObservedRunningTime="2026-07-20 22:24:11.721258637 +0000 UTC m=+105.930091566" Jul 20 22:24:11.767468 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.767423 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qhw9z" podStartSLOduration=65.547986326 podStartE2EDuration="1m10.767409079s" totalImagesPullingTime="5.219422753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:11.766725819 +0000 UTC m=+105.975558772" watchObservedRunningTime="2026-07-20 22:24:11.767409079 +0000 UTC m=+105.976242008" Jul 20 22:24:11.944691 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.944614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:24:11.946844 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:11.946820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b57b631-5b04-4b6d-bb24-6d68c7c58fef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcnjf\" (UID: \"5b57b631-5b04-4b6d-bb24-6d68c7c58fef\") " pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:24:12.231671 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:12.231590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcnjf" Jul 20 22:24:12.375988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:12.375956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcnjf"] Jul 20 22:24:12.379958 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:12.379925 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b57b631_5b04_4b6d_bb24_6d68c7c58fef.slice/crio-efefb374672d4eeaf560f623ffe0a1e9d3004ac8b726402eba713b1a08395a12 WatchSource:0}: Error finding container efefb374672d4eeaf560f623ffe0a1e9d3004ac8b726402eba713b1a08395a12: Status 404 returned error can't find the container with id efefb374672d4eeaf560f623ffe0a1e9d3004ac8b726402eba713b1a08395a12 Jul 20 22:24:12.684685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:12.684646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcnjf" event={"ID":"5b57b631-5b04-4b6d-bb24-6d68c7c58fef","Type":"ContainerStarted","Data":"efefb374672d4eeaf560f623ffe0a1e9d3004ac8b726402eba713b1a08395a12"} Jul 20 22:24:15.291551 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:15.291522 2568 scope.go:117] "RemoveContainer" containerID="9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062" Jul 20 22:24:15.292109 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:24:15.291726 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-flxwd_openshift-console-operator(dcc5d8bd-acce-4a08-9abe-d2f22d383a74)\"" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podUID="dcc5d8bd-acce-4a08-9abe-d2f22d383a74" Jul 20 22:24:17.706076 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:17.706032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcnjf" event={"ID":"5b57b631-5b04-4b6d-bb24-6d68c7c58fef","Type":"ContainerStarted","Data":"71464529923e5e3f28c5b3d388d4e170fa9a20950c94830112e7a5c00ceb9840"} Jul 20 22:24:21.688126 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:21.688093 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qhw9z" Jul 20 22:24:21.723215 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:21.723172 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcnjf" event={"ID":"5b57b631-5b04-4b6d-bb24-6d68c7c58fef","Type":"ContainerStarted","Data":"501226d668699b8fff29ac4fa16b67f691096c80f4defe30434435a33248d769"} Jul 20 22:24:23.562266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.562230 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z7htg"] Jul 20 22:24:23.580399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.580371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.583365 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.583337 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k4svg\"" Jul 20 22:24:23.583875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.583745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 22:24:23.584603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.584579 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 22:24:23.584716 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.584675 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 22:24:23.585529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.585489 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 22:24:23.585851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.585664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 22:24:23.585851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.585664 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 22:24:23.645034 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.644998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxz6\" (UniqueName: \"kubernetes.io/projected/56a51c34-4e11-4f3e-8767-417c0905ec3d-kube-api-access-jtxz6\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-textfile\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-wtmp\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-tls\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-metrics-client-ca\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645456 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-sys\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.645456 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.645408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-root\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746046 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746009 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746221 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-sys\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746221 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746126 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-root\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746221 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxz6\" (UniqueName: \"kubernetes.io/projected/56a51c34-4e11-4f3e-8767-417c0905ec3d-kube-api-access-jtxz6\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746221 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746211 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-sys\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-textfile\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-wtmp\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746373 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-root\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-tls\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-metrics-client-ca\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746817 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746537 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-wtmp\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746817 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746582 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-textfile\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746991 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746964 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.746991 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.746984 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56a51c34-4e11-4f3e-8767-417c0905ec3d-metrics-client-ca\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.748854 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.748834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.748977 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.748947 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56a51c34-4e11-4f3e-8767-417c0905ec3d-node-exporter-tls\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.754210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.754184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxz6\" (UniqueName: \"kubernetes.io/projected/56a51c34-4e11-4f3e-8767-417c0905ec3d-kube-api-access-jtxz6\") pod \"node-exporter-z7htg\" (UID: \"56a51c34-4e11-4f3e-8767-417c0905ec3d\") " pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:23.893463 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:23.893377 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z7htg" Jul 20 22:24:24.234040 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:24.234014 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a51c34_4e11_4f3e_8767_417c0905ec3d.slice/crio-7647f54a4577d02cfb58975c0bb7daa2ae8edcc8648b9c490a33e869b16555e4 WatchSource:0}: Error finding container 7647f54a4577d02cfb58975c0bb7daa2ae8edcc8648b9c490a33e869b16555e4: Status 404 returned error can't find the container with id 7647f54a4577d02cfb58975c0bb7daa2ae8edcc8648b9c490a33e869b16555e4 Jul 20 22:24:24.736386 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:24.736340 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7htg" event={"ID":"56a51c34-4e11-4f3e-8767-417c0905ec3d","Type":"ContainerStarted","Data":"7647f54a4577d02cfb58975c0bb7daa2ae8edcc8648b9c490a33e869b16555e4"} Jul 20 22:24:24.739098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:24.739065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcnjf" event={"ID":"5b57b631-5b04-4b6d-bb24-6d68c7c58fef","Type":"ContainerStarted","Data":"1e231d430175dc4033566087be1d46869b0a40b682d14bb0821516282395eacf"} Jul 20 22:24:24.766998 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:24.766900 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gcnjf" podStartSLOduration=33.010406035 podStartE2EDuration="44.766885718s" totalImagesPullingTime="11.756479683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:24.766837078 +0000 UTC m=+118.975670026" watchObservedRunningTime="2026-07-20 22:24:24.766885718 +0000 UTC m=+118.975718647" Jul 20 22:24:25.743319 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:25.743284 2568 generic.go:356] "Generic (PLEG): container finished" podID="56a51c34-4e11-4f3e-8767-417c0905ec3d" containerID="34e80266ab7b41f21cf586aed667b9d17a045792ebbf7b34dc64473c7321ca43" exitCode=0 Jul 20 22:24:25.743722 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:25.743378 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7htg" event={"ID":"56a51c34-4e11-4f3e-8767-417c0905ec3d","Type":"ContainerDied","Data":"34e80266ab7b41f21cf586aed667b9d17a045792ebbf7b34dc64473c7321ca43"} Jul 20 22:24:26.659676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:26.659648 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:26.749021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:26.748989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7htg" event={"ID":"56a51c34-4e11-4f3e-8767-417c0905ec3d","Type":"ContainerStarted","Data":"5ea954a63bf149696b28054afc23e5f397e1e249c7b4252283d6b2f0167aec74"} Jul 20 22:24:26.749513 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:26.749044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7htg" event={"ID":"56a51c34-4e11-4f3e-8767-417c0905ec3d","Type":"ContainerStarted","Data":"584e8b4f607a84b96d1c6916af4493c1e49e80f7bd5ebe21a1492b2aca42b6c9"} Jul 20 22:24:26.769512 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:26.769446 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z7htg" podStartSLOduration=2.836725034 podStartE2EDuration="3.769426139s" totalImagesPullingTime="870.736684ms" totalInitContainerRuntime="61.964421ms" isStatefulPod=true podCreationTimestamp="2026-07-20 22:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:26.768753745 +0000 UTC m=+120.977586676" watchObservedRunningTime="2026-07-20 22:24:26.769426139 +0000 UTC m=+120.978259069" Jul 20 22:24:28.350424 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:28.350389 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:24:30.291622 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:30.291589 2568 scope.go:117] "RemoveContainer" containerID="9daf755bf56aed36607e7299cb49f9f5bae70393214d2cbbe17f929650ff7062" Jul 20 22:24:30.764693 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:30.764658 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:24:30.764896 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:30.764756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" event={"ID":"dcc5d8bd-acce-4a08-9abe-d2f22d383a74","Type":"ContainerStarted","Data":"af3790bbdec3a0dc907dcacf00b031a713862f177984ee13aa9990a8d85ebad4"} Jul 20 22:24:30.765053 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:30.765027 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:24:30.781923 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:30.781866 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" podStartSLOduration=53.299008241 podStartE2EDuration="57.781849523s" totalImagesPullingTime="4.482841282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:30.780844406 +0000 UTC m=+124.989677336" watchObservedRunningTime="2026-07-20 22:24:30.781849523 +0000 UTC m=+124.990682494" Jul 20 22:24:31.323119 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.323089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-flxwd" Jul 20 22:24:31.622748 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.622663 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6vcvs"] Jul 20 22:24:31.625806 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.625788 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:31.632060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.631772 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4g9t7\"" Jul 20 22:24:31.632060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.631915 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 22:24:31.632060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.632026 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 22:24:31.664574 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.664534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6vcvs"] Jul 20 22:24:31.714803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.714766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqwf\" (UniqueName: \"kubernetes.io/projected/9001bc55-1841-44ab-9cdb-41ca869231e4-kube-api-access-kzqwf\") pod \"downloads-5bc67dcd46-6vcvs\" (UID: \"9001bc55-1841-44ab-9cdb-41ca869231e4\") " pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:31.815376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.815333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqwf\" (UniqueName: \"kubernetes.io/projected/9001bc55-1841-44ab-9cdb-41ca869231e4-kube-api-access-kzqwf\") pod \"downloads-5bc67dcd46-6vcvs\" (UID: \"9001bc55-1841-44ab-9cdb-41ca869231e4\") " pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:31.834293 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.834262 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqwf\" (UniqueName: \"kubernetes.io/projected/9001bc55-1841-44ab-9cdb-41ca869231e4-kube-api-access-kzqwf\") pod \"downloads-5bc67dcd46-6vcvs\" (UID: \"9001bc55-1841-44ab-9cdb-41ca869231e4\") " pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:31.934590 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:31.934491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:32.074154 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:32.074077 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6vcvs"] Jul 20 22:24:32.077625 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:32.077595 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9001bc55_1841_44ab_9cdb_41ca869231e4.slice/crio-dce2795fb456e5e66e3e49414c89fb98e451fe25a73c6e2bb6648946d866d001 WatchSource:0}: Error finding container dce2795fb456e5e66e3e49414c89fb98e451fe25a73c6e2bb6648946d866d001: Status 404 returned error can't find the container with id dce2795fb456e5e66e3e49414c89fb98e451fe25a73c6e2bb6648946d866d001 Jul 20 22:24:32.773015 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:32.772973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6vcvs" event={"ID":"9001bc55-1841-44ab-9cdb-41ca869231e4","Type":"ContainerStarted","Data":"dce2795fb456e5e66e3e49414c89fb98e451fe25a73c6e2bb6648946d866d001"} Jul 20 22:24:36.048749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.048707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:24:36.051657 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.051632 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20532715-6bae-4a56-85df-4baa1c1d52c1-metrics-certs\") pod \"network-metrics-daemon-v7v9x\" (UID: \"20532715-6bae-4a56-85df-4baa1c1d52c1\") " pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:24:36.213540 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.213487 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wpkcl\"" Jul 20 22:24:36.221574 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.221542 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7v9x" Jul 20 22:24:36.371019 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.370987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7v9x"] Jul 20 22:24:36.374488 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:36.374455 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20532715_6bae_4a56_85df_4baa1c1d52c1.slice/crio-04bd64d4ce86e86a0b41ae99008e9f73229f01c1ad42954d311c4eb93351e47b WatchSource:0}: Error finding container 04bd64d4ce86e86a0b41ae99008e9f73229f01c1ad42954d311c4eb93351e47b: Status 404 returned error can't find the container with id 04bd64d4ce86e86a0b41ae99008e9f73229f01c1ad42954d311c4eb93351e47b Jul 20 22:24:36.791413 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:36.791334 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7v9x" event={"ID":"20532715-6bae-4a56-85df-4baa1c1d52c1","Type":"ContainerStarted","Data":"04bd64d4ce86e86a0b41ae99008e9f73229f01c1ad42954d311c4eb93351e47b"} Jul 20 22:24:37.796718 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:37.796677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7v9x" event={"ID":"20532715-6bae-4a56-85df-4baa1c1d52c1","Type":"ContainerStarted","Data":"2a9f6a179a2f53cc96ac9e3ea1c596d6b4ccaf5b4759d442455985075b19ef7b"} Jul 20 22:24:37.797141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:37.796738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7v9x" event={"ID":"20532715-6bae-4a56-85df-4baa1c1d52c1","Type":"ContainerStarted","Data":"950d9414a6a43143e075eac9ef3c196d4e2612fe02135802328d42f93d6c98fa"} Jul 20 22:24:37.818012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:37.817873 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v7v9x" podStartSLOduration=130.73063227 podStartE2EDuration="2m11.817849433s" totalImagesPullingTime="1.087217163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:37.815106532 +0000 UTC m=+132.023939461" watchObservedRunningTime="2026-07-20 22:24:37.817849433 +0000 UTC m=+132.026682364" Jul 20 22:24:44.246544 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.246494 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:24:44.277582 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.277538 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:24:44.277771 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.277667 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.280685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.280659 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 22:24:44.280685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.280675 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8cdxb\"" Jul 20 22:24:44.281377 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.281356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 22:24:44.281474 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.281375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 22:24:44.281474 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.281379 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 22:24:44.281474 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.281356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 22:24:44.424009 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.423887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.424621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.424318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.424621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.424359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.424621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.424404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.424621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.424446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbh6g\" (UniqueName: \"kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.424621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.424481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525143 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525143 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525119 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525374 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525374 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525374 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbh6g\" (UniqueName: \"kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525374 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.525988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525957 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.526090 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525988 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.526090 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.525957 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.528262 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.528239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.528395 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.528283 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.534710 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.534681 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbh6g\" (UniqueName: \"kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g\") pod \"console-88948bff8-hgbc5\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:44.588180 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:44.588143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:49.494695 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.494663 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:24:49.498633 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:49.498596 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b0ece0_f8d4_408e_bf2c_57e8d041005f.slice/crio-42ac97f86a9cd1e76b186405d09a4aadd3b81bf5ad78adf10724067b0acd552d WatchSource:0}: Error finding container 42ac97f86a9cd1e76b186405d09a4aadd3b81bf5ad78adf10724067b0acd552d: Status 404 returned error can't find the container with id 42ac97f86a9cd1e76b186405d09a4aadd3b81bf5ad78adf10724067b0acd552d Jul 20 22:24:49.846614 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.846579 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6vcvs" event={"ID":"9001bc55-1841-44ab-9cdb-41ca869231e4","Type":"ContainerStarted","Data":"90267a5c3ab7464ab2e0ecef4ae9248d4ce33f42b894463c0bf88fd3243b10df"} Jul 20 22:24:49.846811 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.846746 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:49.848030 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.847998 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88948bff8-hgbc5" event={"ID":"08b0ece0-f8d4-408e-bf2c-57e8d041005f","Type":"ContainerStarted","Data":"42ac97f86a9cd1e76b186405d09a4aadd3b81bf5ad78adf10724067b0acd552d"} Jul 20 22:24:49.848424 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.848400 2568 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-6vcvs container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused" start-of-body= Jul 20 22:24:49.848474 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.848447 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-6vcvs" podUID="9001bc55-1841-44ab-9cdb-41ca869231e4" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 22:24:49.866844 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:49.866787 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6vcvs" podStartSLOduration=1.309095747 podStartE2EDuration="18.86676983s" totalImagesPullingTime="17.557674083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:49.865993697 +0000 UTC m=+144.074826625" watchObservedRunningTime="2026-07-20 22:24:49.86676983 +0000 UTC m=+144.075602759" Jul 20 22:24:50.862626 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:50.862586 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6vcvs" Jul 20 22:24:51.822246 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.822186 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:24:51.853964 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.853909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:24:51.854206 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.853925 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.863754 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.863569 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29h5b\" (UniqueName: \"kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:51.991741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:51.991668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.092946 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.092818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.092946 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.092905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.092946 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.092943 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.093381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.092979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.093381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.093011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.093381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.093049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.093381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.093076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29h5b\" (UniqueName: \"kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.093847 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.093777 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.094253 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.094164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.094643 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.094601 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.094753 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.094678 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.097765 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.097692 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.097885 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.097791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.101698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.101662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29h5b\" (UniqueName: \"kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b\") pod \"console-559848d478-8vggm\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.167923 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.167845 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:24:52.979144 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:52.978964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:24:52.982294 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:24:52.982256 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode101e1d5_62a9_4e9d_b16d_c1fe57269838.slice/crio-5e47311aeee7d24592b8aa1622a05c8e97fb4b1516e00f0752ec00e767d79e4d WatchSource:0}: Error finding container 5e47311aeee7d24592b8aa1622a05c8e97fb4b1516e00f0752ec00e767d79e4d: Status 404 returned error can't find the container with id 5e47311aeee7d24592b8aa1622a05c8e97fb4b1516e00f0752ec00e767d79e4d Jul 20 22:24:53.371177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.371128 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" podUID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" containerName="registry" containerID="cri-o://ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87" gracePeriod=30 Jul 20 22:24:53.669900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.669863 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:53.810425 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810388 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810433 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810468 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810508 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2qmj\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810551 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810610 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810897 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810651 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.810897 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810679 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token\") pod \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\" (UID: \"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001\") " Jul 20 22:24:53.811001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.810980 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:24:53.811389 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.811304 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:24:53.813786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.813647 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:24:53.813786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.813664 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:24:53.813786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.813691 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:24:53.814313 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.814284 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:24:53.815259 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.815230 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj" (OuterVolumeSpecName: "kube-api-access-n2qmj") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "kube-api-access-n2qmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:24:53.821431 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.821388 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" (UID: "4e4e84b8-5b1f-4cf4-978a-06cc2d88a001"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:24:53.869207 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.869167 2568 generic.go:356] "Generic (PLEG): container finished" podID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" containerID="ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87" exitCode=0 Jul 20 22:24:53.869381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.869221 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" Jul 20 22:24:53.869381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.869265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" event={"ID":"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001","Type":"ContainerDied","Data":"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87"} Jul 20 22:24:53.869381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.869323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64667d6dc6-wz2xm" event={"ID":"4e4e84b8-5b1f-4cf4-978a-06cc2d88a001","Type":"ContainerDied","Data":"1995dc5811fd5e877eb18466dfe846145a57df527e6118de9e339c82f0504460"} Jul 20 22:24:53.869381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.869355 2568 scope.go:117] "RemoveContainer" containerID="ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87" Jul 20 22:24:53.871443 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.871382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559848d478-8vggm" event={"ID":"e101e1d5-62a9-4e9d-b16d-c1fe57269838","Type":"ContainerStarted","Data":"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138"} Jul 20 22:24:53.871443 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.871429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559848d478-8vggm" event={"ID":"e101e1d5-62a9-4e9d-b16d-c1fe57269838","Type":"ContainerStarted","Data":"5e47311aeee7d24592b8aa1622a05c8e97fb4b1516e00f0752ec00e767d79e4d"} Jul 20 22:24:53.873481 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.873454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88948bff8-hgbc5" event={"ID":"08b0ece0-f8d4-408e-bf2c-57e8d041005f","Type":"ContainerStarted","Data":"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba"} Jul 20 22:24:53.879352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.879333 2568 scope.go:117] "RemoveContainer" containerID="ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87" Jul 20 22:24:53.879690 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:24:53.879660 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87\": container with ID starting with ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87 not found: ID does not exist" containerID="ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87" Jul 20 22:24:53.879769 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.879700 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87"} err="failed to get container status \"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87\": rpc error: code = NotFound desc = could not find container \"ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87\": container with ID starting with ec119f46f1ef2a2d1558ce896e105a8a9d3b33859514246e40a80ea10d1b0e87 not found: ID does not exist" Jul 20 22:24:53.897058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.897001 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88948bff8-hgbc5" podStartSLOduration=6.167801674 podStartE2EDuration="9.896979003s" totalImagesPullingTime="3.729177329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:53.895340227 +0000 UTC m=+148.104173157" watchObservedRunningTime="2026-07-20 22:24:53.896979003 +0000 UTC m=+148.105811933" Jul 20 22:24:53.912098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912067 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-bound-sa-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912100 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-image-registry-private-configuration\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912118 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912132 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-installation-pull-secrets\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912148 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2qmj\" (UniqueName: \"kubernetes.io/projected/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-kube-api-access-n2qmj\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912159 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-registry-certificates\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912171 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-ca-trust-extracted\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.912289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.912184 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001-trusted-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:24:53.914560 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.914494 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559848d478-8vggm" podStartSLOduration=2.348017903 podStartE2EDuration="2.914478432s" totalImagesPullingTime="566.460529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:53.91375331 +0000 UTC m=+148.122586245" watchObservedRunningTime="2026-07-20 22:24:53.914478432 +0000 UTC m=+148.123311361" Jul 20 22:24:53.927170 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.927140 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:24:53.932138 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:53.932113 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64667d6dc6-wz2xm"] Jul 20 22:24:54.300747 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:54.297968 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" path="/var/lib/kubelet/pods/4e4e84b8-5b1f-4cf4-978a-06cc2d88a001/volumes" Jul 20 22:24:54.588744 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:54.588696 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:54.589009 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:54.588776 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:54.594438 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:54.594410 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:24:54.883663 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:24:54.883588 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:25:02.168360 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:02.168326 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:25:02.168923 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:02.168406 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:25:02.173292 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:02.173263 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:25:02.913282 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:02.913253 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:25:02.963287 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:02.963252 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:25:09.933096 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:09.933060 2568 generic.go:356] "Generic (PLEG): container finished" podID="5840144e-ef60-4fdb-9ab4-63f0754ec0da" containerID="00ef21f21bf81e16a1f656df04671cf563b9da75da556e650374fa0a01f8382b" exitCode=0 Jul 20 22:25:09.933524 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:09.933132 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" event={"ID":"5840144e-ef60-4fdb-9ab4-63f0754ec0da","Type":"ContainerDied","Data":"00ef21f21bf81e16a1f656df04671cf563b9da75da556e650374fa0a01f8382b"} Jul 20 22:25:09.933524 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:09.933453 2568 scope.go:117] "RemoveContainer" containerID="00ef21f21bf81e16a1f656df04671cf563b9da75da556e650374fa0a01f8382b" Jul 20 22:25:10.938442 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:10.938406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zk8ph" event={"ID":"5840144e-ef60-4fdb-9ab4-63f0754ec0da","Type":"ContainerStarted","Data":"60a39c7e2f854c167a73cff2209bcaf14cf91730fce07193c50cb9265c4cd7f2"} Jul 20 22:25:28.001123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.001077 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-88948bff8-hgbc5" podUID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" containerName="console" containerID="cri-o://82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba" gracePeriod=15 Jul 20 22:25:28.287805 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.287770 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:25:28.380607 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380570 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.380607 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380614 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.380859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380647 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.380859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380671 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbh6g\" (UniqueName: \"kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.380859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380688 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.380859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.380714 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert\") pod \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\" (UID: \"08b0ece0-f8d4-408e-bf2c-57e8d041005f\") " Jul 20 22:25:28.381094 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381060 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca" (OuterVolumeSpecName: "service-ca") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:25:28.381166 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381099 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:25:28.381166 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381128 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config" (OuterVolumeSpecName: "console-config") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:25:28.381270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381235 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:28.381270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381253 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:28.381270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.381267 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:28.383081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.383055 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g" (OuterVolumeSpecName: "kube-api-access-tbh6g") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "kube-api-access-tbh6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:25:28.383286 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.383245 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:25:28.383381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.383263 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08b0ece0-f8d4-408e-bf2c-57e8d041005f" (UID: "08b0ece0-f8d4-408e-bf2c-57e8d041005f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:25:28.482189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.482147 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:28.482189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.482181 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbh6g\" (UniqueName: \"kubernetes.io/projected/08b0ece0-f8d4-408e-bf2c-57e8d041005f-kube-api-access-tbh6g\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:28.482189 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:28.482190 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b0ece0-f8d4-408e-bf2c-57e8d041005f-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:25:29.009624 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.009588 2568 generic.go:356] "Generic (PLEG): container finished" podID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" containerID="82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba" exitCode=0 Jul 20 22:25:29.009624 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.009632 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88948bff8-hgbc5" Jul 20 22:25:29.010108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.009662 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88948bff8-hgbc5" event={"ID":"08b0ece0-f8d4-408e-bf2c-57e8d041005f","Type":"ContainerDied","Data":"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba"} Jul 20 22:25:29.010108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.009744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88948bff8-hgbc5" event={"ID":"08b0ece0-f8d4-408e-bf2c-57e8d041005f","Type":"ContainerDied","Data":"42ac97f86a9cd1e76b186405d09a4aadd3b81bf5ad78adf10724067b0acd552d"} Jul 20 22:25:29.010108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.009765 2568 scope.go:117] "RemoveContainer" containerID="82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba" Jul 20 22:25:29.018960 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.018938 2568 scope.go:117] "RemoveContainer" containerID="82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba" Jul 20 22:25:29.019212 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:25:29.019194 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba\": container with ID starting with 82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba not found: ID does not exist" containerID="82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba" Jul 20 22:25:29.019273 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.019219 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba"} err="failed to get container status \"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba\": rpc error: code = NotFound desc = could not find container \"82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba\": container with ID starting with 82e74bc5268aa26078491fd4914d14e11f7f326d7b91eefa64eaecdd71e05fba not found: ID does not exist" Jul 20 22:25:29.031188 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.031163 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:25:29.034982 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:29.034961 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88948bff8-hgbc5"] Jul 20 22:25:30.296095 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:30.296058 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" path="/var/lib/kubelet/pods/08b0ece0-f8d4-408e-bf2c-57e8d041005f/volumes" Jul 20 22:25:47.898857 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.898820 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b97bf7848-wgsvh"] Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899097 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" containerName="registry" Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899108 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" containerName="registry" Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899118 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" containerName="console" Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899124 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" containerName="console" Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899174 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e4e84b8-5b1f-4cf4-978a-06cc2d88a001" containerName="registry" Jul 20 22:25:47.899311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.899182 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b0ece0-f8d4-408e-bf2c-57e8d041005f" containerName="console" Jul 20 22:25:47.902128 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.902108 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:47.904493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.904462 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 20 22:25:47.904646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.904490 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 20 22:25:47.904646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.904594 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 20 22:25:47.904990 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.904974 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 20 22:25:47.905169 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.905148 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j8pb2\"" Jul 20 22:25:47.905289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.905275 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 20 22:25:47.911173 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.911145 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 20 22:25:47.929177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:47.929145 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b97bf7848-wgsvh"] Jul 20 22:25:48.029290 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-serving-certs-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029470 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvwc9\" (UniqueName: \"kubernetes.io/projected/aa79df3d-a4b9-4b53-b919-81d35e947bf8-kube-api-access-gvwc9\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-federate-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.029683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.029573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-metrics-client-ca\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.130763 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.130763 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130793 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvwc9\" (UniqueName: \"kubernetes.io/projected/aa79df3d-a4b9-4b53-b919-81d35e947bf8-kube-api-access-gvwc9\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-federate-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-metrics-client-ca\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.130934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-serving-certs-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131818 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.131786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-serving-certs-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.131961 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.131786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-metrics-client-ca\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.132079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.131972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.134019 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.133994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-telemeter-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.134019 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.134008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.134142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.134017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-federate-client-tls\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.134142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.134046 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aa79df3d-a4b9-4b53-b919-81d35e947bf8-secret-telemeter-client\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.139842 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.139820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvwc9\" (UniqueName: \"kubernetes.io/projected/aa79df3d-a4b9-4b53-b919-81d35e947bf8-kube-api-access-gvwc9\") pod \"telemeter-client-5b97bf7848-wgsvh\" (UID: \"aa79df3d-a4b9-4b53-b919-81d35e947bf8\") " pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.211619 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.211536 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" Jul 20 22:25:48.352449 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:48.352306 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b97bf7848-wgsvh"] Jul 20 22:25:48.354494 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:25:48.354467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa79df3d_a4b9_4b53_b919_81d35e947bf8.slice/crio-8b04b5b7681831c6a326f545991062b9eaad4bed16947ce75c078788028f96a0 WatchSource:0}: Error finding container 8b04b5b7681831c6a326f545991062b9eaad4bed16947ce75c078788028f96a0: Status 404 returned error can't find the container with id 8b04b5b7681831c6a326f545991062b9eaad4bed16947ce75c078788028f96a0 Jul 20 22:25:49.082800 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:49.082761 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" event={"ID":"aa79df3d-a4b9-4b53-b919-81d35e947bf8","Type":"ContainerStarted","Data":"8b04b5b7681831c6a326f545991062b9eaad4bed16947ce75c078788028f96a0"} Jul 20 22:25:51.092306 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:51.092267 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" event={"ID":"aa79df3d-a4b9-4b53-b919-81d35e947bf8","Type":"ContainerStarted","Data":"4a1207882bb35e3d5eebc3ab1c32239c06c8a12119f37c47b2030c96109a390d"} Jul 20 22:25:52.097749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.097714 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" event={"ID":"aa79df3d-a4b9-4b53-b919-81d35e947bf8","Type":"ContainerStarted","Data":"f086de8a85cc7f6feb434e617690330367c2eb928285a8c0ff7eddeee35a081e"} Jul 20 22:25:52.098145 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.097777 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" event={"ID":"aa79df3d-a4b9-4b53-b919-81d35e947bf8","Type":"ContainerStarted","Data":"57fb292524da5ada6c4070703ab65901d326c04097551cb3a9141427accbc00f"} Jul 20 22:25:52.123897 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.123842 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b97bf7848-wgsvh" podStartSLOduration=1.897497335 podStartE2EDuration="5.123825304s" totalImagesPullingTime="3.226327969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:52.122848116 +0000 UTC m=+206.331681046" watchObservedRunningTime="2026-07-20 22:25:52.123825304 +0000 UTC m=+206.332658232" Jul 20 22:25:52.817813 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.817773 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:25:52.821691 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.821659 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.832893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.832860 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:25:52.971832 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.971832 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.972151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.972151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.972151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.972151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.971990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:52.972151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:52.972029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5cr\" (UniqueName: \"kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5cr\" (UniqueName: \"kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.073749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.073593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.074337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.074310 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.074454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.074339 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.074454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.074369 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.074607 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.074479 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.076178 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.076154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.076258 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.076154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.096886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.096851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5cr\" (UniqueName: \"kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr\") pod \"console-6898ddf675-fp94c\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.134038 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.134002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:25:53.275480 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:53.275447 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:25:53.278232 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:25:53.278210 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f775ef1_90c7_4320_a933_b19d65f93c7e.slice/crio-08dcdbc3c86be933a8a7b8c2959c34896bfe1f0f9e883416398ffef603b94d5e WatchSource:0}: Error finding container 08dcdbc3c86be933a8a7b8c2959c34896bfe1f0f9e883416398ffef603b94d5e: Status 404 returned error can't find the container with id 08dcdbc3c86be933a8a7b8c2959c34896bfe1f0f9e883416398ffef603b94d5e Jul 20 22:25:54.107718 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:54.107677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898ddf675-fp94c" event={"ID":"2f775ef1-90c7-4320-a933-b19d65f93c7e","Type":"ContainerStarted","Data":"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c"} Jul 20 22:25:54.107718 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:54.107726 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898ddf675-fp94c" event={"ID":"2f775ef1-90c7-4320-a933-b19d65f93c7e","Type":"ContainerStarted","Data":"08dcdbc3c86be933a8a7b8c2959c34896bfe1f0f9e883416398ffef603b94d5e"} Jul 20 22:25:54.126893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:25:54.126836 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6898ddf675-fp94c" podStartSLOduration=2.126820275 podStartE2EDuration="2.126820275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:54.12606984 +0000 UTC m=+208.334902770" watchObservedRunningTime="2026-07-20 22:25:54.126820275 +0000 UTC m=+208.335653203" Jul 20 22:26:03.134932 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:03.134898 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:26:03.135359 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:03.134961 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:26:03.140086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:03.140058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:26:03.144381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:03.144357 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:26:03.209733 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:03.209702 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:26:28.230117 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.230076 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559848d478-8vggm" podUID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" containerName="console" containerID="cri-o://856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138" gracePeriod=15 Jul 20 22:26:28.470382 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.470351 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:26:28.563359 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563323 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563566 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563367 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563566 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563397 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563566 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563447 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563566 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563480 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563784 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563634 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563784 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563682 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29h5b\" (UniqueName: \"kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b\") pod \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\" (UID: \"e101e1d5-62a9-4e9d-b16d-c1fe57269838\") " Jul 20 22:26:28.563888 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563815 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config" (OuterVolumeSpecName: "console-config") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:26:28.563888 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563871 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca" (OuterVolumeSpecName: "service-ca") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:26:28.564057 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.563943 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:26:28.564115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.564063 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.564115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.564081 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.564186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.564110 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:26:28.565711 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.565689 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b" (OuterVolumeSpecName: "kube-api-access-29h5b") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "kube-api-access-29h5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:26:28.565791 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.565762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:26:28.565830 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.565797 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e101e1d5-62a9-4e9d-b16d-c1fe57269838" (UID: "e101e1d5-62a9-4e9d-b16d-c1fe57269838"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:26:28.664570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.664482 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.664570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.664564 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e101e1d5-62a9-4e9d-b16d-c1fe57269838-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.664570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.664575 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-trusted-ca-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.664570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.664584 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e101e1d5-62a9-4e9d-b16d-c1fe57269838-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:28.664570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:28.664592 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29h5b\" (UniqueName: \"kubernetes.io/projected/e101e1d5-62a9-4e9d-b16d-c1fe57269838-kube-api-access-29h5b\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:26:29.232295 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.232254 2568 generic.go:356] "Generic (PLEG): container finished" podID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" containerID="856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138" exitCode=0 Jul 20 22:26:29.232825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.232319 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559848d478-8vggm" Jul 20 22:26:29.232825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.232338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559848d478-8vggm" event={"ID":"e101e1d5-62a9-4e9d-b16d-c1fe57269838","Type":"ContainerDied","Data":"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138"} Jul 20 22:26:29.232825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.232418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559848d478-8vggm" event={"ID":"e101e1d5-62a9-4e9d-b16d-c1fe57269838","Type":"ContainerDied","Data":"5e47311aeee7d24592b8aa1622a05c8e97fb4b1516e00f0752ec00e767d79e4d"} Jul 20 22:26:29.232825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.232438 2568 scope.go:117] "RemoveContainer" containerID="856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138" Jul 20 22:26:29.241124 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.241104 2568 scope.go:117] "RemoveContainer" containerID="856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138" Jul 20 22:26:29.241386 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:26:29.241369 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138\": container with ID starting with 856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138 not found: ID does not exist" containerID="856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138" Jul 20 22:26:29.241441 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.241393 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138"} err="failed to get container status \"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138\": rpc error: code = NotFound desc = could not find container \"856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138\": container with ID starting with 856a3db6341f934b8f9a9830b0f8ac7c592d4747b7f633bdeb9c7e1427d5b138 not found: ID does not exist" Jul 20 22:26:29.252775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.252745 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:26:29.256668 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:29.256635 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559848d478-8vggm"] Jul 20 22:26:30.294745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:26:30.294714 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" path="/var/lib/kubelet/pods/e101e1d5-62a9-4e9d-b16d-c1fe57269838/volumes" Jul 20 22:27:00.975893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.975795 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:27:00.976487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.976086 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" containerName="console" Jul 20 22:27:00.976487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.976099 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" containerName="console" Jul 20 22:27:00.976487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.976160 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e101e1d5-62a9-4e9d-b16d-c1fe57269838" containerName="console" Jul 20 22:27:00.979223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.979200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:00.993113 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:00.993083 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:27:01.116199 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116199 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgn9\" (UniqueName: \"kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.116428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.116427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.217068 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.217017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.217289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.217081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.217289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.217114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.217289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.217138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgn9\" (UniqueName: \"kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.217289 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.217166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.218302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.218381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.218426 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.218744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219141 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.218834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.219529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.219448 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.223517 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.221311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.224363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.224340 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.231448 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.231397 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgn9\" (UniqueName: \"kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9\") pod \"console-6dd575f4c8-p9md6\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.290243 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.290195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:01.447223 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:01.447190 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:27:01.451119 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:27:01.451077 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e4ab43_ff0d_4ba3_8f4a_1a216a92ebda.slice/crio-2847fe00c175ad9a63355c9a00e41936d7159d0464fb553f4610e30c0e7728a3 WatchSource:0}: Error finding container 2847fe00c175ad9a63355c9a00e41936d7159d0464fb553f4610e30c0e7728a3: Status 404 returned error can't find the container with id 2847fe00c175ad9a63355c9a00e41936d7159d0464fb553f4610e30c0e7728a3 Jul 20 22:27:02.354563 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:02.354523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd575f4c8-p9md6" event={"ID":"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda","Type":"ContainerStarted","Data":"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6"} Jul 20 22:27:02.354940 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:02.354580 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd575f4c8-p9md6" event={"ID":"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda","Type":"ContainerStarted","Data":"2847fe00c175ad9a63355c9a00e41936d7159d0464fb553f4610e30c0e7728a3"} Jul 20 22:27:02.378925 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:02.378863 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd575f4c8-p9md6" podStartSLOduration=2.378842518 podStartE2EDuration="2.378842518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:02.377716926 +0000 UTC m=+276.586549855" watchObservedRunningTime="2026-07-20 22:27:02.378842518 +0000 UTC m=+276.587675449" Jul 20 22:27:11.290886 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:11.290830 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:11.291349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:11.290914 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:11.295779 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:11.295753 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:11.392072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:11.392042 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:27:11.598878 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:11.598844 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:27:26.216246 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:26.216219 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:27:26.223387 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:26.223361 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:27:26.226442 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:26.226420 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 22:27:36.624615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.624573 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6898ddf675-fp94c" podUID="2f775ef1-90c7-4320-a933-b19d65f93c7e" containerName="console" containerID="cri-o://7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c" gracePeriod=15 Jul 20 22:27:36.862060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.862033 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:27:36.893790 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893693 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.893790 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893746 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.893790 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893769 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.893790 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893786 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.894111 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893805 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.894111 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893831 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.894111 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.893957 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn5cr\" (UniqueName: \"kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr\") pod \"2f775ef1-90c7-4320-a933-b19d65f93c7e\" (UID: \"2f775ef1-90c7-4320-a933-b19d65f93c7e\") " Jul 20 22:27:36.894328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.894291 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:27:36.894457 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.894305 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config" (OuterVolumeSpecName: "console-config") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:27:36.894457 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.894332 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:27:36.894599 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.894483 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:27:36.895997 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.895965 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:27:36.896107 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.896027 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:27:36.896169 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.896145 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr" (OuterVolumeSpecName: "kube-api-access-pn5cr") pod "2f775ef1-90c7-4320-a933-b19d65f93c7e" (UID: "2f775ef1-90c7-4320-a933-b19d65f93c7e"). InnerVolumeSpecName "kube-api-access-pn5cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:27:36.994828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994783 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn5cr\" (UniqueName: \"kubernetes.io/projected/2f775ef1-90c7-4320-a933-b19d65f93c7e-kube-api-access-pn5cr\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.994828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994822 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.994828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994835 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.995071 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994847 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.995071 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994859 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.995071 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994870 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-trusted-ca-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:36.995071 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:36.994880 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f775ef1-90c7-4320-a933-b19d65f93c7e-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:27:37.486097 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.486060 2568 generic.go:356] "Generic (PLEG): container finished" podID="2f775ef1-90c7-4320-a933-b19d65f93c7e" containerID="7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c" exitCode=0 Jul 20 22:27:37.486265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.486105 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6898ddf675-fp94c" Jul 20 22:27:37.486265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.486122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898ddf675-fp94c" event={"ID":"2f775ef1-90c7-4320-a933-b19d65f93c7e","Type":"ContainerDied","Data":"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c"} Jul 20 22:27:37.486265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.486164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6898ddf675-fp94c" event={"ID":"2f775ef1-90c7-4320-a933-b19d65f93c7e","Type":"ContainerDied","Data":"08dcdbc3c86be933a8a7b8c2959c34896bfe1f0f9e883416398ffef603b94d5e"} Jul 20 22:27:37.486265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.486182 2568 scope.go:117] "RemoveContainer" containerID="7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c" Jul 20 22:27:37.494420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.494403 2568 scope.go:117] "RemoveContainer" containerID="7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c" Jul 20 22:27:37.494722 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:27:37.494700 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c\": container with ID starting with 7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c not found: ID does not exist" containerID="7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c" Jul 20 22:27:37.494786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.494734 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c"} err="failed to get container status \"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c\": rpc error: code = NotFound desc = could not find container \"7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c\": container with ID starting with 7d7063bdbabe67cbb21a6af389016ec0dfc50193a7781a925b68f88001fa294c not found: ID does not exist" Jul 20 22:27:37.507658 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.507626 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:27:37.513119 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:37.513092 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6898ddf675-fp94c"] Jul 20 22:27:38.295149 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:38.295114 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f775ef1-90c7-4320-a933-b19d65f93c7e" path="/var/lib/kubelet/pods/2f775ef1-90c7-4320-a933-b19d65f93c7e/volumes" Jul 20 22:27:54.342420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.342378 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7"] Jul 20 22:27:54.342815 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.342682 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f775ef1-90c7-4320-a933-b19d65f93c7e" containerName="console" Jul 20 22:27:54.342815 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.342695 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f775ef1-90c7-4320-a933-b19d65f93c7e" containerName="console" Jul 20 22:27:54.342815 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.342743 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f775ef1-90c7-4320-a933-b19d65f93c7e" containerName="console" Jul 20 22:27:54.345787 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.345769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.348852 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.348831 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 22:27:54.348971 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.348950 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kz5z6\"" Jul 20 22:27:54.349370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.349353 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 22:27:54.359691 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.359664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7"] Jul 20 22:27:54.417117 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.417071 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.417117 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.417122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mn9l\" (UniqueName: \"kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.417340 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.417201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.517921 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.517885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.518104 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.517934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn9l\" (UniqueName: \"kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.518104 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.517984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.518334 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.518310 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.518399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.518377 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.531838 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.531809 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mn9l\" (UniqueName: \"kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.654473 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.654375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:27:54.805295 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.805259 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7"] Jul 20 22:27:54.810411 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:27:54.810385 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e023c4_c642_4103_8a4e_d6b55e3a4bae.slice/crio-1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408 WatchSource:0}: Error finding container 1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408: Status 404 returned error can't find the container with id 1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408 Jul 20 22:27:54.812363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:54.812344 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 22:27:55.554666 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:27:55.554628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" event={"ID":"40e023c4-c642-4103-8a4e-d6b55e3a4bae","Type":"ContainerStarted","Data":"1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408"} Jul 20 22:28:01.578973 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:01.578934 2568 generic.go:356] "Generic (PLEG): container finished" podID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerID="1481ecb8ed9408fe177b4d4724c1a8ba333cdb0811d91039a0a4b96df1ad5ce0" exitCode=0 Jul 20 22:28:01.579433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:01.578984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" event={"ID":"40e023c4-c642-4103-8a4e-d6b55e3a4bae","Type":"ContainerDied","Data":"1481ecb8ed9408fe177b4d4724c1a8ba333cdb0811d91039a0a4b96df1ad5ce0"} Jul 20 22:28:04.594265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:04.594229 2568 generic.go:356] "Generic (PLEG): container finished" podID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerID="b0a683b208bf4c324a21b3ebfcf0eb961323f17767a8f86515d954f51a1109cd" exitCode=0 Jul 20 22:28:04.594703 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:04.594289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" event={"ID":"40e023c4-c642-4103-8a4e-d6b55e3a4bae","Type":"ContainerDied","Data":"b0a683b208bf4c324a21b3ebfcf0eb961323f17767a8f86515d954f51a1109cd"} Jul 20 22:28:12.629569 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:12.629527 2568 generic.go:356] "Generic (PLEG): container finished" podID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerID="10ec36828fc2327b99930a2d7601b0be45c1b6c95a8ca3d6ffca02012b27f2bd" exitCode=0 Jul 20 22:28:12.629986 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:12.629582 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" event={"ID":"40e023c4-c642-4103-8a4e-d6b55e3a4bae","Type":"ContainerDied","Data":"10ec36828fc2327b99930a2d7601b0be45c1b6c95a8ca3d6ffca02012b27f2bd"} Jul 20 22:28:13.758437 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.758410 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:28:13.878070 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.878030 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util\") pod \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " Jul 20 22:28:13.878242 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.878079 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mn9l\" (UniqueName: \"kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l\") pod \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " Jul 20 22:28:13.878242 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.878107 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle\") pod \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\" (UID: \"40e023c4-c642-4103-8a4e-d6b55e3a4bae\") " Jul 20 22:28:13.878787 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.878756 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle" (OuterVolumeSpecName: "bundle") pod "40e023c4-c642-4103-8a4e-d6b55e3a4bae" (UID: "40e023c4-c642-4103-8a4e-d6b55e3a4bae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:13.880308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.880278 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l" (OuterVolumeSpecName: "kube-api-access-7mn9l") pod "40e023c4-c642-4103-8a4e-d6b55e3a4bae" (UID: "40e023c4-c642-4103-8a4e-d6b55e3a4bae"). InnerVolumeSpecName "kube-api-access-7mn9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:28:13.882211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.882191 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util" (OuterVolumeSpecName: "util") pod "40e023c4-c642-4103-8a4e-d6b55e3a4bae" (UID: "40e023c4-c642-4103-8a4e-d6b55e3a4bae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:13.979527 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.979460 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mn9l\" (UniqueName: \"kubernetes.io/projected/40e023c4-c642-4103-8a4e-d6b55e3a4bae-kube-api-access-7mn9l\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:13.979527 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.979517 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:13.979527 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:13.979529 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40e023c4-c642-4103-8a4e-d6b55e3a4bae-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:14.638828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:14.638748 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" Jul 20 22:28:14.638980 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:14.638746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrp7" event={"ID":"40e023c4-c642-4103-8a4e-d6b55e3a4bae","Type":"ContainerDied","Data":"1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408"} Jul 20 22:28:14.638980 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:14.638875 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1326b31042509a67486f298efb9a8323ec8a987794258e7eed33703885c2f408" Jul 20 22:28:19.538639 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538545 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr"] Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538926 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="extract" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538943 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="extract" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538963 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="util" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538971 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="util" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.538994 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="pull" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.539002 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="pull" Jul 20 22:28:19.539098 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.539067 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e023c4-c642-4103-8a4e-d6b55e3a4bae" containerName="extract" Jul 20 22:28:19.554557 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.554522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.559341 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.559316 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 22:28:19.561012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.560775 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wblh5\"" Jul 20 22:28:19.561012 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.560821 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 22:28:19.576961 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.576927 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr"] Jul 20 22:28:19.628417 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.628368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p82qw\" (UniqueName: \"kubernetes.io/projected/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-kube-api-access-p82qw\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.628632 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.628427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.729070 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.729041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p82qw\" (UniqueName: \"kubernetes.io/projected/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-kube-api-access-p82qw\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.729216 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.729080 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.729402 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.729386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.751252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.751215 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p82qw\" (UniqueName: \"kubernetes.io/projected/7a97b8f6-9875-4da8-ba5f-6babbcc614d7-kube-api-access-p82qw\") pod \"cert-manager-operator-controller-manager-55c444bf86-ppxfr\" (UID: \"7a97b8f6-9875-4da8-ba5f-6babbcc614d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:19.863603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:19.863570 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" Jul 20 22:28:20.053679 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:20.053634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr"] Jul 20 22:28:20.057136 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:28:20.057100 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a97b8f6_9875_4da8_ba5f_6babbcc614d7.slice/crio-621b776a4dcc767a11ea6777e5abdb453302bdddbcdcc28495d69d807b6ae8bb WatchSource:0}: Error finding container 621b776a4dcc767a11ea6777e5abdb453302bdddbcdcc28495d69d807b6ae8bb: Status 404 returned error can't find the container with id 621b776a4dcc767a11ea6777e5abdb453302bdddbcdcc28495d69d807b6ae8bb Jul 20 22:28:20.662090 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:20.662055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" event={"ID":"7a97b8f6-9875-4da8-ba5f-6babbcc614d7","Type":"ContainerStarted","Data":"621b776a4dcc767a11ea6777e5abdb453302bdddbcdcc28495d69d807b6ae8bb"} Jul 20 22:28:22.672049 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:22.672013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" event={"ID":"7a97b8f6-9875-4da8-ba5f-6babbcc614d7","Type":"ContainerStarted","Data":"a3c684017af21ff9a8f4e0c1ca154fcf9f6a99cfeba684d037358c74f1d0d0fa"} Jul 20 22:28:22.711829 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:22.711772 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ppxfr" podStartSLOduration=2.126352605 podStartE2EDuration="3.711755107s" totalImagesPullingTime="1.585402502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:22.708984409 +0000 UTC m=+356.917817339" watchObservedRunningTime="2026-07-20 22:28:22.711755107 +0000 UTC m=+356.920588095" Jul 20 22:28:23.687894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.687857 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl"] Jul 20 22:28:23.691541 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.691517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.707872 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.707839 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kz5z6\"" Jul 20 22:28:23.730215 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.730185 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 22:28:23.730382 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.730298 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 22:28:23.736193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.736167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl"] Jul 20 22:28:23.862958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.862915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbpx\" (UniqueName: \"kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.862958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.862966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.863169 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.862984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.964329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.964235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbpx\" (UniqueName: \"kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.964329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.964287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.964329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.964306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.964759 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.964740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.964803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.964744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:23.993958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:23.993922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbpx\" (UniqueName: \"kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:24.000687 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:24.000663 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:24.151965 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:24.151931 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl"] Jul 20 22:28:24.154967 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:28:24.154937 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6255f4d6_d567_4fc7_996c_849b682e12ac.slice/crio-6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5 WatchSource:0}: Error finding container 6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5: Status 404 returned error can't find the container with id 6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5 Jul 20 22:28:24.681351 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:24.681315 2568 generic.go:356] "Generic (PLEG): container finished" podID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerID="42e10f3a26ecd514191114d3f886db910f5c9d5fc3fa462239f654d5923cec90" exitCode=0 Jul 20 22:28:24.681562 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:24.681406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" event={"ID":"6255f4d6-d567-4fc7-996c-849b682e12ac","Type":"ContainerDied","Data":"42e10f3a26ecd514191114d3f886db910f5c9d5fc3fa462239f654d5923cec90"} Jul 20 22:28:24.681562 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:24.681461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" event={"ID":"6255f4d6-d567-4fc7-996c-849b682e12ac","Type":"ContainerStarted","Data":"6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5"} Jul 20 22:28:26.692193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:26.692153 2568 generic.go:356] "Generic (PLEG): container finished" podID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerID="b1e05f3c1632ab2a59564b7ce1369cbebf976a25fa3a0cf010d95004d3035431" exitCode=0 Jul 20 22:28:26.692615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:26.692212 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" event={"ID":"6255f4d6-d567-4fc7-996c-849b682e12ac","Type":"ContainerDied","Data":"b1e05f3c1632ab2a59564b7ce1369cbebf976a25fa3a0cf010d95004d3035431"} Jul 20 22:28:27.138394 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.138316 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-78pst"] Jul 20 22:28:27.141316 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.141296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.143975 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.143951 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 22:28:27.143975 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.143953 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 22:28:27.144657 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.144640 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9gf9q\"" Jul 20 22:28:27.155410 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.155385 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-78pst"] Jul 20 22:28:27.288465 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.288432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.288659 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.288469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpc5\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-kube-api-access-7gpc5\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.389262 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.389177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpc5\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-kube-api-access-7gpc5\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.389420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.389279 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.398042 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.398007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.398134 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.398114 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpc5\" (UniqueName: \"kubernetes.io/projected/972b6744-7124-44ff-bc19-3a3e7e4860a2-kube-api-access-7gpc5\") pod \"cert-manager-cainjector-559cdd8c87-78pst\" (UID: \"972b6744-7124-44ff-bc19-3a3e7e4860a2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.450585 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.450557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" Jul 20 22:28:27.577243 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.577219 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-78pst"] Jul 20 22:28:27.579732 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:28:27.579704 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod972b6744_7124_44ff_bc19_3a3e7e4860a2.slice/crio-9d7c84a48ac871cb8ba135028862f04a9297a1eaa68dae58d55ef9e9e84c38f9 WatchSource:0}: Error finding container 9d7c84a48ac871cb8ba135028862f04a9297a1eaa68dae58d55ef9e9e84c38f9: Status 404 returned error can't find the container with id 9d7c84a48ac871cb8ba135028862f04a9297a1eaa68dae58d55ef9e9e84c38f9 Jul 20 22:28:27.698686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.698596 2568 generic.go:356] "Generic (PLEG): container finished" podID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerID="6d32a1ef92ee3e2e1da3def6ccc33e24e83a3a9ac7e7c49b459ef39160e16ee1" exitCode=0 Jul 20 22:28:27.699101 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.698693 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" event={"ID":"6255f4d6-d567-4fc7-996c-849b682e12ac","Type":"ContainerDied","Data":"6d32a1ef92ee3e2e1da3def6ccc33e24e83a3a9ac7e7c49b459ef39160e16ee1"} Jul 20 22:28:27.699770 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:27.699749 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" event={"ID":"972b6744-7124-44ff-bc19-3a3e7e4860a2","Type":"ContainerStarted","Data":"9d7c84a48ac871cb8ba135028862f04a9297a1eaa68dae58d55ef9e9e84c38f9"} Jul 20 22:28:28.853539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:28.853509 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:29.003348 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.003266 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle\") pod \"6255f4d6-d567-4fc7-996c-849b682e12ac\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " Jul 20 22:28:29.003348 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.003323 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util\") pod \"6255f4d6-d567-4fc7-996c-849b682e12ac\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " Jul 20 22:28:29.003592 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.003364 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtbpx\" (UniqueName: \"kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx\") pod \"6255f4d6-d567-4fc7-996c-849b682e12ac\" (UID: \"6255f4d6-d567-4fc7-996c-849b682e12ac\") " Jul 20 22:28:29.003730 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.003684 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle" (OuterVolumeSpecName: "bundle") pod "6255f4d6-d567-4fc7-996c-849b682e12ac" (UID: "6255f4d6-d567-4fc7-996c-849b682e12ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:29.005836 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.005805 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx" (OuterVolumeSpecName: "kube-api-access-dtbpx") pod "6255f4d6-d567-4fc7-996c-849b682e12ac" (UID: "6255f4d6-d567-4fc7-996c-849b682e12ac"). InnerVolumeSpecName "kube-api-access-dtbpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:28:29.009849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.009820 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util" (OuterVolumeSpecName: "util") pod "6255f4d6-d567-4fc7-996c-849b682e12ac" (UID: "6255f4d6-d567-4fc7-996c-849b682e12ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:29.104459 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.104420 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:29.104459 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.104454 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6255f4d6-d567-4fc7-996c-849b682e12ac-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:29.104459 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.104464 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtbpx\" (UniqueName: \"kubernetes.io/projected/6255f4d6-d567-4fc7-996c-849b682e12ac-kube-api-access-dtbpx\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:29.711452 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.711414 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" event={"ID":"6255f4d6-d567-4fc7-996c-849b682e12ac","Type":"ContainerDied","Data":"6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5"} Jul 20 22:28:29.711452 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.711452 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqd4dl" Jul 20 22:28:29.711702 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:29.711473 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6becc9210cebcd5ff857fb3ce91ee2aea7d3ca57e51875b042017a24227ec6f5" Jul 20 22:28:30.716603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:30.716563 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" event={"ID":"972b6744-7124-44ff-bc19-3a3e7e4860a2","Type":"ContainerStarted","Data":"6e1188f3e2b183c5a5c33e7ae4759a21c22b02da57e251cdd73a4bc66e92074c"} Jul 20 22:28:30.741148 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:30.741094 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-78pst" podStartSLOduration=1.421713579 podStartE2EDuration="3.741079167s" totalImagesPullingTime="2.319365588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:30.739927755 +0000 UTC m=+364.948760695" watchObservedRunningTime="2026-07-20 22:28:30.741079167 +0000 UTC m=+364.949912096" Jul 20 22:28:36.005960 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.005923 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l"] Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006189 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="extract" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006199 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="extract" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006222 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="util" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006228 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="util" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006236 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="pull" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006241 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="pull" Jul 20 22:28:36.006327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.006287 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6255f4d6-d567-4fc7-996c-849b682e12ac" containerName="extract" Jul 20 22:28:36.009156 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.009139 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.011529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.011489 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q8nmt\"" Jul 20 22:28:36.011681 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.011574 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 22:28:36.012254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.012233 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 22:28:36.019177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.019153 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l"] Jul 20 22:28:36.158690 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.158639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnkq\" (UniqueName: \"kubernetes.io/projected/46e37220-a608-48c4-b176-918b622237a0-kube-api-access-qfnkq\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.158888 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.158760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e37220-a608-48c4-b176-918b622237a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.260021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.259914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e37220-a608-48c4-b176-918b622237a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.260021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.259998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnkq\" (UniqueName: \"kubernetes.io/projected/46e37220-a608-48c4-b176-918b622237a0-kube-api-access-qfnkq\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.260324 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.260303 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e37220-a608-48c4-b176-918b622237a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.269224 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.269191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnkq\" (UniqueName: \"kubernetes.io/projected/46e37220-a608-48c4-b176-918b622237a0-kube-api-access-qfnkq\") pod \"openshift-lws-operator-fd8ccff4c-pjp5l\" (UID: \"46e37220-a608-48c4-b176-918b622237a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.318402 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.318369 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" Jul 20 22:28:36.476149 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.452163 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l"] Jul 20 22:28:36.476149 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:28:36.456013 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46e37220_a608_48c4_b176_918b622237a0.slice/crio-dd226fb3880d214e81b83e915f57e792e7a681f178090d6835b9bb85dc6c07ef WatchSource:0}: Error finding container dd226fb3880d214e81b83e915f57e792e7a681f178090d6835b9bb85dc6c07ef: Status 404 returned error can't find the container with id dd226fb3880d214e81b83e915f57e792e7a681f178090d6835b9bb85dc6c07ef Jul 20 22:28:36.743145 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:36.743112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" event={"ID":"46e37220-a608-48c4-b176-918b622237a0","Type":"ContainerStarted","Data":"dd226fb3880d214e81b83e915f57e792e7a681f178090d6835b9bb85dc6c07ef"} Jul 20 22:28:38.754070 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:38.754036 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" event={"ID":"46e37220-a608-48c4-b176-918b622237a0","Type":"ContainerStarted","Data":"d8c9aef8c323a2bdd6bfabce5069519a1ee4b96e30b6f9f19c2b851e5d02d731"} Jul 20 22:28:38.776096 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:38.776038 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pjp5l" podStartSLOduration=2.095465313 podStartE2EDuration="3.77601983s" totalImagesPullingTime="1.680554517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:38.774658228 +0000 UTC m=+372.983491182" watchObservedRunningTime="2026-07-20 22:28:38.77601983 +0000 UTC m=+372.984852801" Jul 20 22:28:41.537193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.537155 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k"] Jul 20 22:28:41.559675 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.559636 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k"] Jul 20 22:28:41.559834 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.559752 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.562646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.562616 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 22:28:41.562795 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.562646 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 22:28:41.563485 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.563463 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kz5z6\"" Jul 20 22:28:41.597423 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.597385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.597596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.597439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trnch\" (UniqueName: \"kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.597596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.597479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.698482 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.698444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.698482 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.698479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trnch\" (UniqueName: \"kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.698737 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.698533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.698881 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.698858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.698919 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.698871 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.708073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.708036 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trnch\" (UniqueName: \"kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:41.869162 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:41.869126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:42.036157 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:42.036124 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k"] Jul 20 22:28:42.038923 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:28:42.038894 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e64f39_d247_4f1d_8001_30adbb33581b.slice/crio-084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619 WatchSource:0}: Error finding container 084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619: Status 404 returned error can't find the container with id 084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619 Jul 20 22:28:42.771745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:42.771710 2568 generic.go:356] "Generic (PLEG): container finished" podID="18e64f39-d247-4f1d-8001-30adbb33581b" containerID="62eb2562d4092818a37719abcc1c0691d9135fdf5994995b1944ae24d310a26f" exitCode=0 Jul 20 22:28:42.771745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:42.771749 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" event={"ID":"18e64f39-d247-4f1d-8001-30adbb33581b","Type":"ContainerDied","Data":"62eb2562d4092818a37719abcc1c0691d9135fdf5994995b1944ae24d310a26f"} Jul 20 22:28:42.772239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:42.771784 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" event={"ID":"18e64f39-d247-4f1d-8001-30adbb33581b","Type":"ContainerStarted","Data":"084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619"} Jul 20 22:28:43.777578 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:43.777539 2568 generic.go:356] "Generic (PLEG): container finished" podID="18e64f39-d247-4f1d-8001-30adbb33581b" containerID="a178148ccb85ea8a57003c500f95a13ae09597cbc87628e0d76d849bcf103d9a" exitCode=0 Jul 20 22:28:43.777578 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:43.777573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" event={"ID":"18e64f39-d247-4f1d-8001-30adbb33581b","Type":"ContainerDied","Data":"a178148ccb85ea8a57003c500f95a13ae09597cbc87628e0d76d849bcf103d9a"} Jul 20 22:28:44.784044 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:44.783997 2568 generic.go:356] "Generic (PLEG): container finished" podID="18e64f39-d247-4f1d-8001-30adbb33581b" containerID="4855235503bf50bedbafd8718022d7938bf1c4a5dffd7e993f79441613c6d4e1" exitCode=0 Jul 20 22:28:44.784423 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:44.784086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" event={"ID":"18e64f39-d247-4f1d-8001-30adbb33581b","Type":"ContainerDied","Data":"4855235503bf50bedbafd8718022d7938bf1c4a5dffd7e993f79441613c6d4e1"} Jul 20 22:28:45.912775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.912749 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:45.936086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.936046 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle\") pod \"18e64f39-d247-4f1d-8001-30adbb33581b\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " Jul 20 22:28:45.936086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.936091 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util\") pod \"18e64f39-d247-4f1d-8001-30adbb33581b\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " Jul 20 22:28:45.936372 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.936132 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trnch\" (UniqueName: \"kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch\") pod \"18e64f39-d247-4f1d-8001-30adbb33581b\" (UID: \"18e64f39-d247-4f1d-8001-30adbb33581b\") " Jul 20 22:28:45.936807 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.936778 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle" (OuterVolumeSpecName: "bundle") pod "18e64f39-d247-4f1d-8001-30adbb33581b" (UID: "18e64f39-d247-4f1d-8001-30adbb33581b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:45.938194 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.938169 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch" (OuterVolumeSpecName: "kube-api-access-trnch") pod "18e64f39-d247-4f1d-8001-30adbb33581b" (UID: "18e64f39-d247-4f1d-8001-30adbb33581b"). InnerVolumeSpecName "kube-api-access-trnch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:28:45.943710 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:45.943667 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util" (OuterVolumeSpecName: "util") pod "18e64f39-d247-4f1d-8001-30adbb33581b" (UID: "18e64f39-d247-4f1d-8001-30adbb33581b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:28:46.036734 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.036679 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:46.036734 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.036728 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18e64f39-d247-4f1d-8001-30adbb33581b-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:46.036734 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.036740 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trnch\" (UniqueName: \"kubernetes.io/projected/18e64f39-d247-4f1d-8001-30adbb33581b-kube-api-access-trnch\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:28:46.794859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.794832 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" event={"ID":"18e64f39-d247-4f1d-8001-30adbb33581b","Type":"ContainerDied","Data":"084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619"} Jul 20 22:28:46.795004 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.794877 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpl94k" Jul 20 22:28:46.795004 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:46.794880 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084ffd86a087077919fa7c2eae3b9d8dcdbacbb32aab1477d6419e7cee785619" Jul 20 22:28:59.839275 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839240 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl"] Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839566 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="pull" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839578 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="pull" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839601 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="util" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839606 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="util" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839611 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="extract" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839617 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="extract" Jul 20 22:28:59.839680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.839661 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e64f39-d247-4f1d-8001-30adbb33581b" containerName="extract" Jul 20 22:28:59.843213 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.843192 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:28:59.849658 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.849629 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 22:28:59.850001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.849980 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 22:28:59.850175 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.850114 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 22:28:59.850595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.850230 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rcrj\"" Jul 20 22:28:59.850595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.850559 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 22:28:59.866441 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.866406 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl"] Jul 20 22:28:59.953726 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.953685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:28:59.953898 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.953735 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lq4q\" (UniqueName: \"kubernetes.io/projected/d3834534-d08e-4fc4-aa3a-db0d470e8595-kube-api-access-4lq4q\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:28:59.953898 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.953778 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:28:59.953898 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.953875 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:28:59.954008 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:28:59.953910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.054895 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.054851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.054895 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.054895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.055105 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.054924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.055105 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.055044 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lq4q\" (UniqueName: \"kubernetes.io/projected/d3834534-d08e-4fc4-aa3a-db0d470e8595-kube-api-access-4lq4q\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.055188 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.055107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.055245 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.055225 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.057177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.057140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3834534-d08e-4fc4-aa3a-db0d470e8595-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.057371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.057355 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.057440 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.057422 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3834534-d08e-4fc4-aa3a-db0d470e8595-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.072747 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.072717 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lq4q\" (UniqueName: \"kubernetes.io/projected/d3834534-d08e-4fc4-aa3a-db0d470e8595-kube-api-access-4lq4q\") pod \"opendatahub-operator-controller-manager-6b4989886d-56wgl\" (UID: \"d3834534-d08e-4fc4-aa3a-db0d470e8595\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.154311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.154216 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:00.322120 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.322095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl"] Jul 20 22:29:00.324363 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:29:00.324327 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3834534_d08e_4fc4_aa3a_db0d470e8595.slice/crio-f12c6d322874b21ce8ca5e700fe0d253aa7eda970448bab542a8a09cf002f4c4 WatchSource:0}: Error finding container f12c6d322874b21ce8ca5e700fe0d253aa7eda970448bab542a8a09cf002f4c4: Status 404 returned error can't find the container with id f12c6d322874b21ce8ca5e700fe0d253aa7eda970448bab542a8a09cf002f4c4 Jul 20 22:29:00.857060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:00.857023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" event={"ID":"d3834534-d08e-4fc4-aa3a-db0d470e8595","Type":"ContainerStarted","Data":"f12c6d322874b21ce8ca5e700fe0d253aa7eda970448bab542a8a09cf002f4c4"} Jul 20 22:29:03.873953 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:03.873916 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" event={"ID":"d3834534-d08e-4fc4-aa3a-db0d470e8595","Type":"ContainerStarted","Data":"96bf88f9229c203f47d455167fb25e7c4b65db85bd6e8ffe757895c98477cecf"} Jul 20 22:29:04.881607 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:04.881563 2568 generic.go:356] "Generic (PLEG): container finished" podID="d3834534-d08e-4fc4-aa3a-db0d470e8595" containerID="96bf88f9229c203f47d455167fb25e7c4b65db85bd6e8ffe757895c98477cecf" exitCode=0 Jul 20 22:29:04.882100 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:04.881650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" event={"ID":"d3834534-d08e-4fc4-aa3a-db0d470e8595","Type":"ContainerDied","Data":"96bf88f9229c203f47d455167fb25e7c4b65db85bd6e8ffe757895c98477cecf"} Jul 20 22:29:05.887418 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:05.887377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" event={"ID":"d3834534-d08e-4fc4-aa3a-db0d470e8595","Type":"ContainerStarted","Data":"ec6ccf67d7a9224486dfdd7bade21c2a9b36102d008978a8524f3c8863f49157"} Jul 20 22:29:05.887866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:05.887473 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:05.912115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:05.912014 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" podStartSLOduration=2.48101082 podStartE2EDuration="6.911998368s" totalImagesPullingTime="3.394988234s" totalInitContainerRuntime="1.035999314s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:05.910403378 +0000 UTC m=+400.119236328" watchObservedRunningTime="2026-07-20 22:29:05.911998368 +0000 UTC m=+400.120831355" Jul 20 22:29:16.893768 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:16.893738 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-56wgl" Jul 20 22:29:20.870380 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:20.870341 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2696"] Jul 20 22:29:20.875210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:20.875183 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:20.878201 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:20.878177 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 22:29:20.878343 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:20.878216 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-drmtv\"" Jul 20 22:29:20.883041 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:20.883013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2696"] Jul 20 22:29:21.029878 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.029839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a621e3-96de-42cc-8f3b-df2f37df167a-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.030050 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.029899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7stz\" (UniqueName: \"kubernetes.io/projected/a1a621e3-96de-42cc-8f3b-df2f37df167a-kube-api-access-k7stz\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.130882 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.130789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7stz\" (UniqueName: \"kubernetes.io/projected/a1a621e3-96de-42cc-8f3b-df2f37df167a-kube-api-access-k7stz\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.130882 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.130861 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a621e3-96de-42cc-8f3b-df2f37df167a-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.133277 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.133239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a621e3-96de-42cc-8f3b-df2f37df167a-tls-certs\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.140528 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.140482 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7stz\" (UniqueName: \"kubernetes.io/projected/a1a621e3-96de-42cc-8f3b-df2f37df167a-kube-api-access-k7stz\") pod \"model-serving-api-54d89bd5fc-t2696\" (UID: \"a1a621e3-96de-42cc-8f3b-df2f37df167a\") " pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.186560 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.186521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:21.324938 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.324904 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t2696"] Jul 20 22:29:21.326255 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:29:21.326223 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a621e3_96de_42cc_8f3b_df2f37df167a.slice/crio-4efba1448d6c447b1ebf2eb945567c5ef4179e6736e205607927c8e2459c8164 WatchSource:0}: Error finding container 4efba1448d6c447b1ebf2eb945567c5ef4179e6736e205607927c8e2459c8164: Status 404 returned error can't find the container with id 4efba1448d6c447b1ebf2eb945567c5ef4179e6736e205607927c8e2459c8164 Jul 20 22:29:21.960583 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:21.960530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" event={"ID":"a1a621e3-96de-42cc-8f3b-df2f37df167a","Type":"ContainerStarted","Data":"4efba1448d6c447b1ebf2eb945567c5ef4179e6736e205607927c8e2459c8164"} Jul 20 22:29:22.968363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:22.968058 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" event={"ID":"a1a621e3-96de-42cc-8f3b-df2f37df167a","Type":"ContainerStarted","Data":"ebbe3a8c167fc804292dd958d797bdfdc40609f7359fee7764822d0bd2cba71a"} Jul 20 22:29:22.968363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:22.968174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:22.988047 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:22.987994 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" podStartSLOduration=1.419601337 podStartE2EDuration="2.987979253s" totalImagesPullingTime="1.568377916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:22.986912168 +0000 UTC m=+417.195745094" watchObservedRunningTime="2026-07-20 22:29:22.987979253 +0000 UTC m=+417.196812182" Jul 20 22:29:26.838964 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.838926 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws"] Jul 20 22:29:26.843763 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.843743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:26.847618 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.847599 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 22:29:26.847710 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.847616 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 22:29:26.847710 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.847635 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 22:29:26.850829 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.850813 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-npv5z\"" Jul 20 22:29:26.867287 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.867260 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws"] Jul 20 22:29:26.983430 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.983395 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:26.983430 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.983435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-manager-config\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:26.983712 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.983454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-metrics-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:26.983712 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:26.983576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhcn\" (UniqueName: \"kubernetes.io/projected/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-kube-api-access-xhhcn\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.084841 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.084807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.084841 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.084844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-manager-config\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.085032 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.084871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-metrics-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.085032 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.084928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhcn\" (UniqueName: \"kubernetes.io/projected/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-kube-api-access-xhhcn\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.085532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.085483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-manager-config\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.087273 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.087252 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-metrics-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.087371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.087297 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-cert\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.103526 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.103462 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhcn\" (UniqueName: \"kubernetes.io/projected/8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0-kube-api-access-xhhcn\") pod \"lws-controller-manager-7f85f98759-4m4ws\" (UID: \"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.152447 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.152419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:27.284989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.284965 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws"] Jul 20 22:29:27.287065 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:29:27.287028 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcd887c_ccbf_4a1a_a84f_2a9df3f4f2b0.slice/crio-0253ca8f11c582299f6337e341e7e7530b7239d9cd8f6998d7331b9e604a25b3 WatchSource:0}: Error finding container 0253ca8f11c582299f6337e341e7e7530b7239d9cd8f6998d7331b9e604a25b3: Status 404 returned error can't find the container with id 0253ca8f11c582299f6337e341e7e7530b7239d9cd8f6998d7331b9e604a25b3 Jul 20 22:29:27.992635 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:27.992592 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" event={"ID":"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0","Type":"ContainerStarted","Data":"0253ca8f11c582299f6337e341e7e7530b7239d9cd8f6998d7331b9e604a25b3"} Jul 20 22:29:31.008777 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:31.008744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" event={"ID":"8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0","Type":"ContainerStarted","Data":"32280b98378c73668d6e3e536bd3de7244ffb290bf3483b03e07e7b18372dac7"} Jul 20 22:29:31.009145 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:31.008863 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:31.129517 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:31.129449 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" podStartSLOduration=2.109451393 podStartE2EDuration="5.129434027s" totalImagesPullingTime="3.019982634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:31.127881766 +0000 UTC m=+425.336714696" watchObservedRunningTime="2026-07-20 22:29:31.129434027 +0000 UTC m=+425.338267015" Jul 20 22:29:33.977109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:33.977071 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-t2696" Jul 20 22:29:41.079287 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.079253 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b"] Jul 20 22:29:41.089445 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.089415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.092466 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.092419 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 22:29:41.092641 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.092569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s8pd5\"" Jul 20 22:29:41.093132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.093103 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 22:29:41.093211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.093128 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 22:29:41.104219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104318 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104318 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104318 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56dbw\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-kube-api-access-56dbw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104376 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.104451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.104424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.123778 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.123748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b"] Jul 20 22:29:41.204996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.204965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.204996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.204999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205026 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56dbw\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-kube-api-access-56dbw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205540 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205623 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205572 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205735 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205632 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.205735 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.205671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.206317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.206295 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.207427 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.207407 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.207916 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.207897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.227116 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.227076 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.227254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.227157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56dbw\" (UniqueName: \"kubernetes.io/projected/7753fa81-93c7-4c60-b9ac-2311ccb489b6-kube-api-access-56dbw\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678x269b\" (UID: \"7753fa81-93c7-4c60-b9ac-2311ccb489b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.403876 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.403766 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:41.587487 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:41.587447 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b"] Jul 20 22:29:41.591013 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:29:41.590985 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7753fa81_93c7_4c60_b9ac_2311ccb489b6.slice/crio-dca0a2995193b709c6b26f98ca46169cd40f6732a7a3ededb399baf26fa86201 WatchSource:0}: Error finding container dca0a2995193b709c6b26f98ca46169cd40f6732a7a3ededb399baf26fa86201: Status 404 returned error can't find the container with id dca0a2995193b709c6b26f98ca46169cd40f6732a7a3ededb399baf26fa86201 Jul 20 22:29:42.014978 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:42.014942 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-4m4ws" Jul 20 22:29:42.059192 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:42.059146 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" event={"ID":"7753fa81-93c7-4c60-b9ac-2311ccb489b6","Type":"ContainerStarted","Data":"dca0a2995193b709c6b26f98ca46169cd40f6732a7a3ededb399baf26fa86201"} Jul 20 22:29:44.239793 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:44.239758 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:29:44.240060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:44.239834 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:29:44.240060 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:44.239864 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:29:45.075360 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:45.075326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" event={"ID":"7753fa81-93c7-4c60-b9ac-2311ccb489b6","Type":"ContainerStarted","Data":"218c59193718c9770beb754c3f1d5e8c2c7d5db54653839421c667eee9d497bd"} Jul 20 22:29:45.121516 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:45.121446 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" podStartSLOduration=1.4748484450000001 podStartE2EDuration="4.121427131s" totalImagesPullingTime="2.646578686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:45.121156298 +0000 UTC m=+439.329989228" watchObservedRunningTime="2026-07-20 22:29:45.121427131 +0000 UTC m=+439.330260059" Jul 20 22:29:45.404687 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:45.404611 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:45.409438 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:45.409412 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:46.080257 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:46.080223 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:29:46.081351 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:29:46.081327 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678x269b" Jul 20 22:30:20.801550 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.801519 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:20.804716 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.804699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:20.807436 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.807412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 22:30:20.808130 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.808114 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j9bsv\"" Jul 20 22:30:20.808208 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.808110 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 22:30:20.816140 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.816107 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:20.935126 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:20.935096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz\") pod \"kuadrant-operator-catalog-8cjz5\" (UID: \"4e877546-42f9-4309-afa6-3edb9134a81d\") " pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:21.036081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.036043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz\") pod \"kuadrant-operator-catalog-8cjz5\" (UID: \"4e877546-42f9-4309-afa6-3edb9134a81d\") " pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:21.047688 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.047654 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz\") pod \"kuadrant-operator-catalog-8cjz5\" (UID: \"4e877546-42f9-4309-afa6-3edb9134a81d\") " pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:21.115413 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.115339 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:21.151741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.151703 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:21.243800 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.243774 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:21.245687 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:21.245658 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e877546_42f9_4309_afa6_3edb9134a81d.slice/crio-d2e65045a49c74ef038e49298ae5c60386b0dc51ef4f7e5038049438189fc534 WatchSource:0}: Error finding container d2e65045a49c74ef038e49298ae5c60386b0dc51ef4f7e5038049438189fc534: Status 404 returned error can't find the container with id d2e65045a49c74ef038e49298ae5c60386b0dc51ef4f7e5038049438189fc534 Jul 20 22:30:21.369596 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.369527 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nm9jp"] Jul 20 22:30:21.373724 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.373708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:21.383251 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.383224 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nm9jp"] Jul 20 22:30:21.440080 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.440054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkf5\" (UniqueName: \"kubernetes.io/projected/4c77184c-1b38-4420-8146-db7177009d90-kube-api-access-rwkf5\") pod \"kuadrant-operator-catalog-nm9jp\" (UID: \"4c77184c-1b38-4420-8146-db7177009d90\") " pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:21.540950 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.540911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkf5\" (UniqueName: \"kubernetes.io/projected/4c77184c-1b38-4420-8146-db7177009d90-kube-api-access-rwkf5\") pod \"kuadrant-operator-catalog-nm9jp\" (UID: \"4c77184c-1b38-4420-8146-db7177009d90\") " pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:21.550269 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.550245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkf5\" (UniqueName: \"kubernetes.io/projected/4c77184c-1b38-4420-8146-db7177009d90-kube-api-access-rwkf5\") pod \"kuadrant-operator-catalog-nm9jp\" (UID: \"4c77184c-1b38-4420-8146-db7177009d90\") " pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:21.683766 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.683669 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:21.813534 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:21.813491 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nm9jp"] Jul 20 22:30:21.816323 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:21.816292 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c77184c_1b38_4420_8146_db7177009d90.slice/crio-371aa4a12b147d750309441a00f77343e4c3762b23cce10cf8e37c66354698e1 WatchSource:0}: Error finding container 371aa4a12b147d750309441a00f77343e4c3762b23cce10cf8e37c66354698e1: Status 404 returned error can't find the container with id 371aa4a12b147d750309441a00f77343e4c3762b23cce10cf8e37c66354698e1 Jul 20 22:30:22.244672 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:22.244631 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" event={"ID":"4c77184c-1b38-4420-8146-db7177009d90","Type":"ContainerStarted","Data":"371aa4a12b147d750309441a00f77343e4c3762b23cce10cf8e37c66354698e1"} Jul 20 22:30:22.246140 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:22.246110 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" event={"ID":"4e877546-42f9-4309-afa6-3edb9134a81d","Type":"ContainerStarted","Data":"d2e65045a49c74ef038e49298ae5c60386b0dc51ef4f7e5038049438189fc534"} Jul 20 22:30:24.257485 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.257440 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" event={"ID":"4c77184c-1b38-4420-8146-db7177009d90","Type":"ContainerStarted","Data":"cfd9db59de2211de7614c92eae258343e6ec6b84174daf6d56edd06e82047fd6"} Jul 20 22:30:24.258931 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.258898 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" event={"ID":"4e877546-42f9-4309-afa6-3edb9134a81d","Type":"ContainerStarted","Data":"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6"} Jul 20 22:30:24.259088 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.258942 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" podUID="4e877546-42f9-4309-afa6-3edb9134a81d" containerName="registry-server" containerID="cri-o://9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6" gracePeriod=2 Jul 20 22:30:24.291070 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.291016 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" podStartSLOduration=1.382519865 podStartE2EDuration="3.291000538s" totalImagesPullingTime="1.908480673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:24.290783715 +0000 UTC m=+478.499616644" watchObservedRunningTime="2026-07-20 22:30:24.291000538 +0000 UTC m=+478.499833493" Jul 20 22:30:24.505301 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.505272 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:24.667860 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.667823 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz\") pod \"4e877546-42f9-4309-afa6-3edb9134a81d\" (UID: \"4e877546-42f9-4309-afa6-3edb9134a81d\") " Jul 20 22:30:24.670005 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.669975 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz" (OuterVolumeSpecName: "kube-api-access-g62lz") pod "4e877546-42f9-4309-afa6-3edb9134a81d" (UID: "4e877546-42f9-4309-afa6-3edb9134a81d"). InnerVolumeSpecName "kube-api-access-g62lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:30:24.768849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:24.768814 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g62lz\" (UniqueName: \"kubernetes.io/projected/4e877546-42f9-4309-afa6-3edb9134a81d-kube-api-access-g62lz\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:25.264370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.264331 2568 generic.go:356] "Generic (PLEG): container finished" podID="4e877546-42f9-4309-afa6-3edb9134a81d" containerID="9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6" exitCode=0 Jul 20 22:30:25.264370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.264373 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" Jul 20 22:30:25.264858 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.264415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" event={"ID":"4e877546-42f9-4309-afa6-3edb9134a81d","Type":"ContainerDied","Data":"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6"} Jul 20 22:30:25.264858 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.264465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cjz5" event={"ID":"4e877546-42f9-4309-afa6-3edb9134a81d","Type":"ContainerDied","Data":"d2e65045a49c74ef038e49298ae5c60386b0dc51ef4f7e5038049438189fc534"} Jul 20 22:30:25.264858 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.264486 2568 scope.go:117] "RemoveContainer" containerID="9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6" Jul 20 22:30:25.273548 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.273527 2568 scope.go:117] "RemoveContainer" containerID="9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6" Jul 20 22:30:25.273861 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:30:25.273842 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6\": container with ID starting with 9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6 not found: ID does not exist" containerID="9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6" Jul 20 22:30:25.273915 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.273873 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6"} err="failed to get container status \"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6\": rpc error: code = NotFound desc = could not find container \"9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6\": container with ID starting with 9a096a17f6954dfa4a1ec0de035ac070d55f6954e41c099a3e37e509807a71b6 not found: ID does not exist" Jul 20 22:30:25.286306 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.286276 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:25.295249 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:25.295223 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cjz5"] Jul 20 22:30:26.296844 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:26.296812 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e877546-42f9-4309-afa6-3edb9134a81d" path="/var/lib/kubelet/pods/4e877546-42f9-4309-afa6-3edb9134a81d/volumes" Jul 20 22:30:31.684746 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:31.684711 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:31.685270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:31.684782 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:31.707054 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:31.707019 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:32.318018 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:32.317990 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nm9jp" Jul 20 22:30:36.593106 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.593072 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl"] Jul 20 22:30:36.593533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.593375 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e877546-42f9-4309-afa6-3edb9134a81d" containerName="registry-server" Jul 20 22:30:36.593533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.593385 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e877546-42f9-4309-afa6-3edb9134a81d" containerName="registry-server" Jul 20 22:30:36.593533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.593450 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e877546-42f9-4309-afa6-3edb9134a81d" containerName="registry-server" Jul 20 22:30:36.597979 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.597959 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.600444 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.600424 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rtjj7\"" Jul 20 22:30:36.608617 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.608596 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl"] Jul 20 22:30:36.769599 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.769555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.769816 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.769614 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st5nj\" (UniqueName: \"kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.769816 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.769739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.870912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.870820 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.870912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.870872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st5nj\" (UniqueName: \"kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.870912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.870916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.871300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.871280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.871379 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.871282 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.880668 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.880645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st5nj\" (UniqueName: \"kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:36.907252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:36.907213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:37.040983 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.040955 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl"] Jul 20 22:30:37.043096 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:37.043064 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747656e7_f5bc_47d4_a6db_e6cb07d33567.slice/crio-e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5 WatchSource:0}: Error finding container e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5: Status 404 returned error can't find the container with id e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5 Jul 20 22:30:37.187842 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.187800 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd"] Jul 20 22:30:37.191326 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.191298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.199095 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.199066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd"] Jul 20 22:30:37.319620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.319584 2568 generic.go:356] "Generic (PLEG): container finished" podID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerID="8b9a0686f8002a8a6eee801a29baa027aa82a7d2db90b0cb0e7e8bff2af53a51" exitCode=0 Jul 20 22:30:37.319772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.319628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" event={"ID":"747656e7-f5bc-47d4-a6db-e6cb07d33567","Type":"ContainerDied","Data":"8b9a0686f8002a8a6eee801a29baa027aa82a7d2db90b0cb0e7e8bff2af53a51"} Jul 20 22:30:37.319772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.319673 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" event={"ID":"747656e7-f5bc-47d4-a6db-e6cb07d33567","Type":"ContainerStarted","Data":"e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5"} Jul 20 22:30:37.376118 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.376072 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976gn\" (UniqueName: \"kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.376299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.376184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.376299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.376234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.476713 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.476615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.476713 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.476662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.476713 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.476690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976gn\" (UniqueName: \"kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.477065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.477044 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.477132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.477029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.486042 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.486011 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-976gn\" (UniqueName: \"kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.511046 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.511012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:37.643801 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.643770 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd"] Jul 20 22:30:37.646561 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:37.646532 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc261391_19dc_4bbe_b20e_9a4bc4f60879.slice/crio-44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b WatchSource:0}: Error finding container 44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b: Status 404 returned error can't find the container with id 44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b Jul 20 22:30:37.794541 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.794488 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8"] Jul 20 22:30:37.797864 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.797844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:37.806062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.806025 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8"] Jul 20 22:30:37.981338 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.981300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:37.981476 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.981354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:37.981476 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:37.981443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7chn\" (UniqueName: \"kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.082350 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.082303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.082570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.082370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.082570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.082430 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7chn\" (UniqueName: \"kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.082825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.082795 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.082881 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.082804 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.091998 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.091963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7chn\" (UniqueName: \"kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.126560 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.126522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:38.203586 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.203481 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr"] Jul 20 22:30:38.208791 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.208765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.221533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.219527 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr"] Jul 20 22:30:38.270914 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.270886 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8"] Jul 20 22:30:38.273404 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:38.273369 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ca80c8_1096_4fb0_a3df_dde9cf6956c6.slice/crio-04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974 WatchSource:0}: Error finding container 04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974: Status 404 returned error can't find the container with id 04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974 Jul 20 22:30:38.327269 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.327240 2568 generic.go:356] "Generic (PLEG): container finished" podID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerID="f2d19ae0c028c9704096fcb359598258517c73b067143ef4d32fb0797aae0c49" exitCode=0 Jul 20 22:30:38.327376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.327320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" event={"ID":"dc261391-19dc-4bbe-b20e-9a4bc4f60879","Type":"ContainerDied","Data":"f2d19ae0c028c9704096fcb359598258517c73b067143ef4d32fb0797aae0c49"} Jul 20 22:30:38.327428 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.327373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" event={"ID":"dc261391-19dc-4bbe-b20e-9a4bc4f60879","Type":"ContainerStarted","Data":"44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b"} Jul 20 22:30:38.329312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.329291 2568 generic.go:356] "Generic (PLEG): container finished" podID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerID="f951b622fef6bd65208dcd9dde1f0122a12cfb26d8e53e563ec2f71e157ce98c" exitCode=0 Jul 20 22:30:38.329397 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.329368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" event={"ID":"747656e7-f5bc-47d4-a6db-e6cb07d33567","Type":"ContainerDied","Data":"f951b622fef6bd65208dcd9dde1f0122a12cfb26d8e53e563ec2f71e157ce98c"} Jul 20 22:30:38.331200 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.331177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" event={"ID":"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6","Type":"ContainerStarted","Data":"04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974"} Jul 20 22:30:38.384808 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.384773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stfvg\" (UniqueName: \"kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.384939 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.384853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.384939 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.384890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.485594 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.485561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stfvg\" (UniqueName: \"kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.485725 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.485611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.485725 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.485644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.486026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.486000 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.486259 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.486242 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.493427 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.493409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stfvg\" (UniqueName: \"kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.533418 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.533352 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:38.673874 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:38.673847 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr"] Jul 20 22:30:38.675169 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:38.675144 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb537074a_4edc_4d81_9ae9_714c04889fce.slice/crio-42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f WatchSource:0}: Error finding container 42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f: Status 404 returned error can't find the container with id 42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f Jul 20 22:30:39.341176 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.341093 2568 generic.go:356] "Generic (PLEG): container finished" podID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerID="3bac958134123b047267f98a2c793b94283e946e7551e50310f61b62cc84c0a6" exitCode=0 Jul 20 22:30:39.341335 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.341188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" event={"ID":"dc261391-19dc-4bbe-b20e-9a4bc4f60879","Type":"ContainerDied","Data":"3bac958134123b047267f98a2c793b94283e946e7551e50310f61b62cc84c0a6"} Jul 20 22:30:39.342711 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.342683 2568 generic.go:356] "Generic (PLEG): container finished" podID="b537074a-4edc-4d81-9ae9-714c04889fce" containerID="21455941600f28f38285549a370efbc5efa212ee2cb6691a02e43ccd022e1048" exitCode=0 Jul 20 22:30:39.342904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.342721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" event={"ID":"b537074a-4edc-4d81-9ae9-714c04889fce","Type":"ContainerDied","Data":"21455941600f28f38285549a370efbc5efa212ee2cb6691a02e43ccd022e1048"} Jul 20 22:30:39.342904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.342768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" event={"ID":"b537074a-4edc-4d81-9ae9-714c04889fce","Type":"ContainerStarted","Data":"42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f"} Jul 20 22:30:39.344966 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.344917 2568 generic.go:356] "Generic (PLEG): container finished" podID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerID="d34326872719f0a52e18db9f10753132b2762c00204bb743a248f62f60e0d882" exitCode=0 Jul 20 22:30:39.345021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.345001 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" event={"ID":"747656e7-f5bc-47d4-a6db-e6cb07d33567","Type":"ContainerDied","Data":"d34326872719f0a52e18db9f10753132b2762c00204bb743a248f62f60e0d882"} Jul 20 22:30:39.346411 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.346382 2568 generic.go:356] "Generic (PLEG): container finished" podID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerID="7285afe58c17ef3c70dfe46968aa965360c944a6935636bdf709c09cf197c5b7" exitCode=0 Jul 20 22:30:39.346469 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:39.346415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" event={"ID":"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6","Type":"ContainerDied","Data":"7285afe58c17ef3c70dfe46968aa965360c944a6935636bdf709c09cf197c5b7"} Jul 20 22:30:40.353620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.353585 2568 generic.go:356] "Generic (PLEG): container finished" podID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerID="ed57702caf560de03227476449caff8f392c71370c22c88ef6f772e6628cc76c" exitCode=0 Jul 20 22:30:40.354087 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.353677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" event={"ID":"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6","Type":"ContainerDied","Data":"ed57702caf560de03227476449caff8f392c71370c22c88ef6f772e6628cc76c"} Jul 20 22:30:40.355943 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.355919 2568 generic.go:356] "Generic (PLEG): container finished" podID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerID="51e6318b73f901acb5e8a1faec99fb746f514c4818d670d5139f16d342b145c5" exitCode=0 Jul 20 22:30:40.356029 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.355992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" event={"ID":"dc261391-19dc-4bbe-b20e-9a4bc4f60879","Type":"ContainerDied","Data":"51e6318b73f901acb5e8a1faec99fb746f514c4818d670d5139f16d342b145c5"} Jul 20 22:30:40.357644 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.357620 2568 generic.go:356] "Generic (PLEG): container finished" podID="b537074a-4edc-4d81-9ae9-714c04889fce" containerID="9a31ed9302e0a4aed8ef1e88907fdc12a29df5d927a93b47e1c0f5039ce0ec08" exitCode=0 Jul 20 22:30:40.357795 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.357687 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" event={"ID":"b537074a-4edc-4d81-9ae9-714c04889fce","Type":"ContainerDied","Data":"9a31ed9302e0a4aed8ef1e88907fdc12a29df5d927a93b47e1c0f5039ce0ec08"} Jul 20 22:30:40.490024 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.489994 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:40.606080 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.605986 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util\") pod \"747656e7-f5bc-47d4-a6db-e6cb07d33567\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " Jul 20 22:30:40.606080 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.606055 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st5nj\" (UniqueName: \"kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj\") pod \"747656e7-f5bc-47d4-a6db-e6cb07d33567\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " Jul 20 22:30:40.606323 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.606105 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle\") pod \"747656e7-f5bc-47d4-a6db-e6cb07d33567\" (UID: \"747656e7-f5bc-47d4-a6db-e6cb07d33567\") " Jul 20 22:30:40.606810 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.606781 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle" (OuterVolumeSpecName: "bundle") pod "747656e7-f5bc-47d4-a6db-e6cb07d33567" (UID: "747656e7-f5bc-47d4-a6db-e6cb07d33567"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:40.608270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.608243 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj" (OuterVolumeSpecName: "kube-api-access-st5nj") pod "747656e7-f5bc-47d4-a6db-e6cb07d33567" (UID: "747656e7-f5bc-47d4-a6db-e6cb07d33567"). InnerVolumeSpecName "kube-api-access-st5nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:30:40.611058 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.611018 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util" (OuterVolumeSpecName: "util") pod "747656e7-f5bc-47d4-a6db-e6cb07d33567" (UID: "747656e7-f5bc-47d4-a6db-e6cb07d33567"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:40.707237 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.707191 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:40.707237 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.707229 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st5nj\" (UniqueName: \"kubernetes.io/projected/747656e7-f5bc-47d4-a6db-e6cb07d33567-kube-api-access-st5nj\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:40.707417 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:40.707257 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/747656e7-f5bc-47d4-a6db-e6cb07d33567-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:41.364770 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.364734 2568 generic.go:356] "Generic (PLEG): container finished" podID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerID="f69d4cf862034199ed2c1fb7b7a2a392fff75907902bdfda6c8d003b46e53288" exitCode=0 Jul 20 22:30:41.365224 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.364824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" event={"ID":"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6","Type":"ContainerDied","Data":"f69d4cf862034199ed2c1fb7b7a2a392fff75907902bdfda6c8d003b46e53288"} Jul 20 22:30:41.366821 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.366797 2568 generic.go:356] "Generic (PLEG): container finished" podID="b537074a-4edc-4d81-9ae9-714c04889fce" containerID="ba82cd44f2ec641c37c87254630e78e7f940d53d74ba48928733847e35810ff6" exitCode=0 Jul 20 22:30:41.366943 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.366881 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" event={"ID":"b537074a-4edc-4d81-9ae9-714c04889fce","Type":"ContainerDied","Data":"ba82cd44f2ec641c37c87254630e78e7f940d53d74ba48928733847e35810ff6"} Jul 20 22:30:41.368532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.368509 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" event={"ID":"747656e7-f5bc-47d4-a6db-e6cb07d33567","Type":"ContainerDied","Data":"e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5"} Jul 20 22:30:41.368613 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.368552 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl" Jul 20 22:30:41.368613 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.368562 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e041c67b460195ee3ad7113393900a76f34e4e568b3413a4b305259fba5f33a5" Jul 20 22:30:41.498662 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.498639 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:41.513601 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.513576 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-976gn\" (UniqueName: \"kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn\") pod \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " Jul 20 22:30:41.513756 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.513629 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util\") pod \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " Jul 20 22:30:41.513756 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.513685 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle\") pod \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\" (UID: \"dc261391-19dc-4bbe-b20e-9a4bc4f60879\") " Jul 20 22:30:41.514129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.514106 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle" (OuterVolumeSpecName: "bundle") pod "dc261391-19dc-4bbe-b20e-9a4bc4f60879" (UID: "dc261391-19dc-4bbe-b20e-9a4bc4f60879"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:41.515713 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.515681 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn" (OuterVolumeSpecName: "kube-api-access-976gn") pod "dc261391-19dc-4bbe-b20e-9a4bc4f60879" (UID: "dc261391-19dc-4bbe-b20e-9a4bc4f60879"). InnerVolumeSpecName "kube-api-access-976gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:30:41.519680 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.519647 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util" (OuterVolumeSpecName: "util") pod "dc261391-19dc-4bbe-b20e-9a4bc4f60879" (UID: "dc261391-19dc-4bbe-b20e-9a4bc4f60879"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:41.614603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.614565 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:41.614603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.614593 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc261391-19dc-4bbe-b20e-9a4bc4f60879-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:41.614603 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:41.614603 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-976gn\" (UniqueName: \"kubernetes.io/projected/dc261391-19dc-4bbe-b20e-9a4bc4f60879-kube-api-access-976gn\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.375571 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.375542 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" Jul 20 22:30:42.375571 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.375552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd" event={"ID":"dc261391-19dc-4bbe-b20e-9a4bc4f60879","Type":"ContainerDied","Data":"44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b"} Jul 20 22:30:42.376158 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.375613 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44c61b0d55eca3c8c2b82e4a1e59dcbbaa35c293c33cf861744ef37d607a5b3b" Jul 20 22:30:42.524817 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.524791 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:42.526921 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.526905 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:42.622046 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.621958 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stfvg\" (UniqueName: \"kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg\") pod \"b537074a-4edc-4d81-9ae9-714c04889fce\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " Jul 20 22:30:42.622046 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.622006 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util\") pod \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " Jul 20 22:30:42.622046 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.622030 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util\") pod \"b537074a-4edc-4d81-9ae9-714c04889fce\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " Jul 20 22:30:42.622371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.622161 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle\") pod \"b537074a-4edc-4d81-9ae9-714c04889fce\" (UID: \"b537074a-4edc-4d81-9ae9-714c04889fce\") " Jul 20 22:30:42.622371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.622210 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7chn\" (UniqueName: \"kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn\") pod \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " Jul 20 22:30:42.623036 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.622969 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle" (OuterVolumeSpecName: "bundle") pod "b537074a-4edc-4d81-9ae9-714c04889fce" (UID: "b537074a-4edc-4d81-9ae9-714c04889fce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:42.624327 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.624303 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg" (OuterVolumeSpecName: "kube-api-access-stfvg") pod "b537074a-4edc-4d81-9ae9-714c04889fce" (UID: "b537074a-4edc-4d81-9ae9-714c04889fce"). InnerVolumeSpecName "kube-api-access-stfvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:30:42.624858 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.624816 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn" (OuterVolumeSpecName: "kube-api-access-s7chn") pod "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" (UID: "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6"). InnerVolumeSpecName "kube-api-access-s7chn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:30:42.630754 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.630723 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util" (OuterVolumeSpecName: "util") pod "b537074a-4edc-4d81-9ae9-714c04889fce" (UID: "b537074a-4edc-4d81-9ae9-714c04889fce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:42.631514 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.631474 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util" (OuterVolumeSpecName: "util") pod "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" (UID: "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:42.723040 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.722996 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle\") pod \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\" (UID: \"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6\") " Jul 20 22:30:42.723228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723198 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.723228 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723216 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b537074a-4edc-4d81-9ae9-714c04889fce-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.723333 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723230 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7chn\" (UniqueName: \"kubernetes.io/projected/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-kube-api-access-s7chn\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.723333 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723245 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stfvg\" (UniqueName: \"kubernetes.io/projected/b537074a-4edc-4d81-9ae9-714c04889fce-kube-api-access-stfvg\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.723333 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723257 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-util\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:42.723490 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.723467 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle" (OuterVolumeSpecName: "bundle") pod "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" (UID: "b5ca80c8-1096-4fb0-a3df-dde9cf6956c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:30:42.823865 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:42.823817 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5ca80c8-1096-4fb0-a3df-dde9cf6956c6-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:30:43.382108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.382077 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" Jul 20 22:30:43.382108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.382101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8" event={"ID":"b5ca80c8-1096-4fb0-a3df-dde9cf6956c6","Type":"ContainerDied","Data":"04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974"} Jul 20 22:30:43.382676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.382140 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04a1fbefaa2a26633dea1b5fc7b5f8960b75c64d5184b6571276f94f50466974" Jul 20 22:30:43.383943 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.383917 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" event={"ID":"b537074a-4edc-4d81-9ae9-714c04889fce","Type":"ContainerDied","Data":"42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f"} Jul 20 22:30:43.384068 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.383956 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42b6abe334cf515d06075980288682e56b2f004bd7ac4252137c5b37ce8c5e8f" Jul 20 22:30:43.384068 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:43.383964 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr" Jul 20 22:30:49.663818 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.663778 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-szfz6"] Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664080 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664091 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664100 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664107 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664120 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664125 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664132 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664138 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664144 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664150 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664158 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664163 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664168 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664173 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="pull" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664182 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="util" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664188 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="util" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664193 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="util" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664199 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="util" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664205 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664211 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="extract" Jul 20 22:30:49.664210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664216 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="util" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664222 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="util" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664230 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="util" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664235 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="util" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664280 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b537074a-4edc-4d81-9ae9-714c04889fce" containerName="extract" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664288 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="747656e7-f5bc-47d4-a6db-e6cb07d33567" containerName="extract" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664294 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ca80c8-1096-4fb0-a3df-dde9cf6956c6" containerName="extract" Jul 20 22:30:49.664908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.664301 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc261391-19dc-4bbe-b20e-9a4bc4f60879" containerName="extract" Jul 20 22:30:49.667211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.667191 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:49.670299 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.670277 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pxckf\"" Jul 20 22:30:49.692786 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.692754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-szfz6"] Jul 20 22:30:49.776532 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.776482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqq95\" (UniqueName: \"kubernetes.io/projected/7a2cd5e0-5d58-4823-937c-1226e2024cf7-kube-api-access-gqq95\") pod \"authorino-operator-75cc8d5cb7-szfz6\" (UID: \"7a2cd5e0-5d58-4823-937c-1226e2024cf7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:49.877802 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.877763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqq95\" (UniqueName: \"kubernetes.io/projected/7a2cd5e0-5d58-4823-937c-1226e2024cf7-kube-api-access-gqq95\") pod \"authorino-operator-75cc8d5cb7-szfz6\" (UID: \"7a2cd5e0-5d58-4823-937c-1226e2024cf7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:49.898072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.898045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqq95\" (UniqueName: \"kubernetes.io/projected/7a2cd5e0-5d58-4823-937c-1226e2024cf7-kube-api-access-gqq95\") pod \"authorino-operator-75cc8d5cb7-szfz6\" (UID: \"7a2cd5e0-5d58-4823-937c-1226e2024cf7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:49.977338 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:49.977247 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:50.153842 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:50.153811 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-szfz6"] Jul 20 22:30:50.155345 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:50.155319 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2cd5e0_5d58_4823_937c_1226e2024cf7.slice/crio-44e5bc58d67b81f6685f300d029101f3040aecf9305ee332b5425672a2804a01 WatchSource:0}: Error finding container 44e5bc58d67b81f6685f300d029101f3040aecf9305ee332b5425672a2804a01: Status 404 returned error can't find the container with id 44e5bc58d67b81f6685f300d029101f3040aecf9305ee332b5425672a2804a01 Jul 20 22:30:50.417638 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:50.417603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" event={"ID":"7a2cd5e0-5d58-4823-937c-1226e2024cf7","Type":"ContainerStarted","Data":"44e5bc58d67b81f6685f300d029101f3040aecf9305ee332b5425672a2804a01"} Jul 20 22:30:52.429986 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:52.429940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" event={"ID":"7a2cd5e0-5d58-4823-937c-1226e2024cf7","Type":"ContainerStarted","Data":"c5944778b235b3816685ed69aefa199772e58ac7768a1f57ab17dc90213d1587"} Jul 20 22:30:52.430430 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:52.430086 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:30:52.468067 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:52.468009 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" podStartSLOduration=1.328435624 podStartE2EDuration="3.467992187s" totalImagesPullingTime="2.139556563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:52.466786817 +0000 UTC m=+506.675619766" watchObservedRunningTime="2026-07-20 22:30:52.467992187 +0000 UTC m=+506.676825116" Jul 20 22:30:57.630519 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.630473 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9c756f7c-qxnwt"] Jul 20 22:30:57.639062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.639037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.662360 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.662328 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9c756f7c-qxnwt"] Jul 20 22:30:57.750337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-oauth-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m45fm\" (UniqueName: \"kubernetes.io/projected/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-kube-api-access-m45fm\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750630 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-trusted-ca-bundle\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750630 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750436 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-service-ca\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750630 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-oauth-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750630 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.750823 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.750659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852000 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.851960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-oauth-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852171 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852171 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852171 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-oauth-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852171 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m45fm\" (UniqueName: \"kubernetes.io/projected/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-kube-api-access-m45fm\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852409 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-trusted-ca-bundle\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852409 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-service-ca\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852831 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852801 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-oauth-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.852962 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.852863 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-service-ca\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.853085 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.853060 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.853150 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.853089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-trusted-ca-bundle\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.854664 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.854633 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-oauth-config\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.854797 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.854776 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-console-serving-cert\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.876891 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.876866 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m45fm\" (UniqueName: \"kubernetes.io/projected/3f5149ec-1235-4114-b0c2-b5cfd1d9fc95-kube-api-access-m45fm\") pod \"console-6b9c756f7c-qxnwt\" (UID: \"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95\") " pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:57.949988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:57.949886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:30:58.138678 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:58.138653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9c756f7c-qxnwt"] Jul 20 22:30:58.141012 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:30:58.140980 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5149ec_1235_4114_b0c2_b5cfd1d9fc95.slice/crio-db092e2a46f5ae4a058e2a13a08cc153631e5be1cb6d176d72b649245d3e54ef WatchSource:0}: Error finding container db092e2a46f5ae4a058e2a13a08cc153631e5be1cb6d176d72b649245d3e54ef: Status 404 returned error can't find the container with id db092e2a46f5ae4a058e2a13a08cc153631e5be1cb6d176d72b649245d3e54ef Jul 20 22:30:58.464907 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:58.464868 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c756f7c-qxnwt" event={"ID":"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95","Type":"ContainerStarted","Data":"268397e5abd83e01d06333d94f1c0d0ae0d388c601668118dd0c00235d87fc78"} Jul 20 22:30:58.465112 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:30:58.464921 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c756f7c-qxnwt" event={"ID":"3f5149ec-1235-4114-b0c2-b5cfd1d9fc95","Type":"ContainerStarted","Data":"db092e2a46f5ae4a058e2a13a08cc153631e5be1cb6d176d72b649245d3e54ef"} Jul 20 22:31:03.437448 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:03.437416 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-szfz6" Jul 20 22:31:03.467382 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:03.467330 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9c756f7c-qxnwt" podStartSLOduration=6.467314401 podStartE2EDuration="6.467314401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:58.606214676 +0000 UTC m=+512.815047605" watchObservedRunningTime="2026-07-20 22:31:03.467314401 +0000 UTC m=+517.676147331" Jul 20 22:31:07.950066 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:07.950027 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:31:07.950473 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:07.950117 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:31:07.954458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:07.954437 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:31:08.518070 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:08.518040 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9c756f7c-qxnwt" Jul 20 22:31:08.587370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:08.587336 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:31:09.501899 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.501860 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4"] Jul 20 22:31:09.505649 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.505630 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.508919 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.508895 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 20 22:31:09.509069 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.509049 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rtjj7\"" Jul 20 22:31:09.510414 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.510397 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 20 22:31:09.530365 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.530338 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4"] Jul 20 22:31:09.660089 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.660053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brm9c\" (UniqueName: \"kubernetes.io/projected/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-kube-api-access-brm9c\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.660313 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.660112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.660313 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.660185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.761880 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.761765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.761880 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.761883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brm9c\" (UniqueName: \"kubernetes.io/projected/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-kube-api-access-brm9c\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.762123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.761908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.762123 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:31:09.761923 2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 20 22:31:09.762123 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:31:09.761993 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert podName:9fea82c8-d5ef-46d7-96b1-1770aedecbbc nodeName:}" failed. No retries permitted until 2026-07-20 22:31:10.261976579 +0000 UTC m=+524.470809489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zsjf4" (UID: "9fea82c8-d5ef-46d7-96b1-1770aedecbbc") : secret "plugin-serving-cert" not found Jul 20 22:31:09.762516 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.762479 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:09.775339 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:09.775303 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brm9c\" (UniqueName: \"kubernetes.io/projected/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-kube-api-access-brm9c\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:10.267589 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:10.267547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:10.270112 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:10.270083 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fea82c8-d5ef-46d7-96b1-1770aedecbbc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zsjf4\" (UID: \"9fea82c8-d5ef-46d7-96b1-1770aedecbbc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:10.415533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:10.415483 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" Jul 20 22:31:10.560440 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:10.560407 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4"] Jul 20 22:31:10.561533 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:31:10.561493 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fea82c8_d5ef_46d7_96b1_1770aedecbbc.slice/crio-304bb9ea0505ae60cf6249e331e13c46dd2e63922fc3447b0cb1e8c9e18c44be WatchSource:0}: Error finding container 304bb9ea0505ae60cf6249e331e13c46dd2e63922fc3447b0cb1e8c9e18c44be: Status 404 returned error can't find the container with id 304bb9ea0505ae60cf6249e331e13c46dd2e63922fc3447b0cb1e8c9e18c44be Jul 20 22:31:11.535077 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:11.535035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" event={"ID":"9fea82c8-d5ef-46d7-96b1-1770aedecbbc","Type":"ContainerStarted","Data":"304bb9ea0505ae60cf6249e331e13c46dd2e63922fc3447b0cb1e8c9e18c44be"} Jul 20 22:31:33.608748 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.608698 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dd575f4c8-p9md6" podUID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" containerName="console" containerID="cri-o://750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6" gracePeriod=15 Jul 20 22:31:33.660277 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.660237 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" event={"ID":"9fea82c8-d5ef-46d7-96b1-1770aedecbbc","Type":"ContainerStarted","Data":"01b3b8bd9fba0c737c9530187188215de2e351f0c549dffc2a4c2976b879b37b"} Jul 20 22:31:33.691375 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.691315 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zsjf4" podStartSLOduration=2.485783088 podStartE2EDuration="24.691299211s" totalImagesPullingTime="22.205516123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:33.690025351 +0000 UTC m=+547.898858313" watchObservedRunningTime="2026-07-20 22:31:33.691299211 +0000 UTC m=+547.900132144" Jul 20 22:31:33.861861 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.861801 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:31:33.895454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895422 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895462 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895526 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czgn9\" (UniqueName: \"kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895561 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895589 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.895741 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.895685 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert\") pod \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\" (UID: \"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda\") " Jul 20 22:31:33.897026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.896132 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:31:33.897026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.896136 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:31:33.897026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.896167 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:31:33.897026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.896258 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config" (OuterVolumeSpecName: "console-config") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:31:33.898305 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.898278 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:31:33.898891 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.898866 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:31:33.899518 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.899467 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9" (OuterVolumeSpecName: "kube-api-access-czgn9") pod "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" (UID: "f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda"). InnerVolumeSpecName "kube-api-access-czgn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:31:33.997001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.996963 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czgn9\" (UniqueName: \"kubernetes.io/projected/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-kube-api-access-czgn9\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.996994 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.997004 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-trusted-ca-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.997012 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.997021 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.997029 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:33.997239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:33.997037 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:31:34.666092 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.665999 2568 generic.go:356] "Generic (PLEG): container finished" podID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" containerID="750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6" exitCode=0 Jul 20 22:31:34.666092 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.666048 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd575f4c8-p9md6" Jul 20 22:31:34.666092 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.666079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd575f4c8-p9md6" event={"ID":"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda","Type":"ContainerDied","Data":"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6"} Jul 20 22:31:34.666645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.666132 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd575f4c8-p9md6" event={"ID":"f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda","Type":"ContainerDied","Data":"2847fe00c175ad9a63355c9a00e41936d7159d0464fb553f4610e30c0e7728a3"} Jul 20 22:31:34.666645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.666153 2568 scope.go:117] "RemoveContainer" containerID="750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6" Jul 20 22:31:34.674834 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.674815 2568 scope.go:117] "RemoveContainer" containerID="750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6" Jul 20 22:31:34.675109 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:31:34.675088 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6\": container with ID starting with 750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6 not found: ID does not exist" containerID="750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6" Jul 20 22:31:34.675177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.675124 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6"} err="failed to get container status \"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6\": rpc error: code = NotFound desc = could not find container \"750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6\": container with ID starting with 750765fdc37a6c7163d528ca8fb1627e274e7fc3c7da4998e17e499391b20be6 not found: ID does not exist" Jul 20 22:31:34.698330 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.698298 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:31:34.714653 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:34.714627 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd575f4c8-p9md6"] Jul 20 22:31:36.297279 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:36.297242 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" path="/var/lib/kubelet/pods/f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda/volumes" Jul 20 22:31:50.067728 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.067691 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq"] Jul 20 22:31:50.068331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.068016 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" containerName="console" Jul 20 22:31:50.068331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.068026 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" containerName="console" Jul 20 22:31:50.068331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.068093 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e4ab43-ff0d-4ba3-8f4a-1a216a92ebda" containerName="console" Jul 20 22:31:50.078211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.078180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.080997 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.080973 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-79kk5\"" Jul 20 22:31:50.091163 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.091136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq"] Jul 20 22:31:50.139111 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139071 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139111 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139321 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mjkd\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-kube-api-access-4mjkd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139321 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139321 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d04105-61e3-4f26-84ee-c5306c8121a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.139546 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.139453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mjkd\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-kube-api-access-4mjkd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240788 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d04105-61e3-4f26-84ee-c5306c8121a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.240951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.240927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.241310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.241102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.241310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.241150 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.241310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.241206 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.241466 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.241361 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.241761 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.241741 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d04105-61e3-4f26-84ee-c5306c8121a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.243206 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.243187 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.243367 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.243349 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.250642 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.250613 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.250854 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.250827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mjkd\" (UniqueName: \"kubernetes.io/projected/79d04105-61e3-4f26-84ee-c5306c8121a4-kube-api-access-4mjkd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4xhjq\" (UID: \"79d04105-61e3-4f26-84ee-c5306c8121a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.389879 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.389781 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:50.581320 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.581291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq"] Jul 20 22:31:50.583100 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:31:50.583069 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d04105_61e3_4f26_84ee_c5306c8121a4.slice/crio-9223c6ce00c4a2699a63125e7e3cb8e72f133bfcb7624001f152ae89c8bfb364 WatchSource:0}: Error finding container 9223c6ce00c4a2699a63125e7e3cb8e72f133bfcb7624001f152ae89c8bfb364: Status 404 returned error can't find the container with id 9223c6ce00c4a2699a63125e7e3cb8e72f133bfcb7624001f152ae89c8bfb364 Jul 20 22:31:50.585366 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.585335 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:31:50.585457 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.585417 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:31:50.585544 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.585465 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:31:50.755010 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.754972 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" event={"ID":"79d04105-61e3-4f26-84ee-c5306c8121a4","Type":"ContainerStarted","Data":"7864ebf72ab8f9b8ce819444d993a8ccf41ff6a33d7a6bedcda4400752125085"} Jul 20 22:31:50.755186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.755034 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" event={"ID":"79d04105-61e3-4f26-84ee-c5306c8121a4","Type":"ContainerStarted","Data":"9223c6ce00c4a2699a63125e7e3cb8e72f133bfcb7624001f152ae89c8bfb364"} Jul 20 22:31:50.779066 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:50.779015 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" podStartSLOduration=0.778996679 podStartE2EDuration="778.996679ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:50.776674842 +0000 UTC m=+564.985507782" watchObservedRunningTime="2026-07-20 22:31:50.778996679 +0000 UTC m=+564.987829608" Jul 20 22:31:51.390533 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.390491 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:51.395254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.395227 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:51.760216 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.760144 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:51.761020 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.760991 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:31:51.879705 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.879672 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:31:51.909072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.909044 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:51.918513 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.917613 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 22:31:51.919485 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.919454 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:31:51.988715 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:51.988679 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:31:52.059248 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.059211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.059423 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.059269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnht\" (UniqueName: \"kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.160381 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.160342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnht\" (UniqueName: \"kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.160595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.160466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.161181 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.161159 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.173316 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.173287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnht\" (UniqueName: \"kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht\") pod \"limitador-limitador-64c94fd64f-tw2kv\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.222460 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.222419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:52.403859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.403821 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:31:52.407088 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:31:52.407045 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d85219_6480_48a1_87cb_ddb28d1288b8.slice/crio-0b7f31de66ec894f41448677df88c1de1b327a7535fd4dd25d4fdcd327bd6a8a WatchSource:0}: Error finding container 0b7f31de66ec894f41448677df88c1de1b327a7535fd4dd25d4fdcd327bd6a8a: Status 404 returned error can't find the container with id 0b7f31de66ec894f41448677df88c1de1b327a7535fd4dd25d4fdcd327bd6a8a Jul 20 22:31:52.766412 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:52.766329 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" event={"ID":"98d85219-6480-48a1-87cb-ddb28d1288b8","Type":"ContainerStarted","Data":"0b7f31de66ec894f41448677df88c1de1b327a7535fd4dd25d4fdcd327bd6a8a"} Jul 20 22:31:56.789864 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:56.789826 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" event={"ID":"98d85219-6480-48a1-87cb-ddb28d1288b8","Type":"ContainerStarted","Data":"42200939b0167c91d2beaa5ae9d2969f83764f501abd6887d9cabe1c5f1ed82a"} Jul 20 22:31:56.790298 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:56.789978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:31:56.812565 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:31:56.812481 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" podStartSLOduration=2.390225619 podStartE2EDuration="5.812462136s" totalImagesPullingTime="3.422236517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:56.808679613 +0000 UTC m=+571.017512544" watchObservedRunningTime="2026-07-20 22:31:56.812462136 +0000 UTC m=+571.021295069" Jul 20 22:32:07.153426 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:07.153388 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:32:07.153968 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:07.153595 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" podUID="98d85219-6480-48a1-87cb-ddb28d1288b8" containerName="limitador" containerID="cri-o://42200939b0167c91d2beaa5ae9d2969f83764f501abd6887d9cabe1c5f1ed82a" gracePeriod=30 Jul 20 22:32:07.154433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:07.154252 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:32:07.847488 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:07.847453 2568 generic.go:356] "Generic (PLEG): container finished" podID="98d85219-6480-48a1-87cb-ddb28d1288b8" containerID="42200939b0167c91d2beaa5ae9d2969f83764f501abd6887d9cabe1c5f1ed82a" exitCode=0 Jul 20 22:32:07.847683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:07.847529 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" event={"ID":"98d85219-6480-48a1-87cb-ddb28d1288b8","Type":"ContainerDied","Data":"42200939b0167c91d2beaa5ae9d2969f83764f501abd6887d9cabe1c5f1ed82a"} Jul 20 22:32:08.104587 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.104490 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:32:08.204404 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.204360 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vnht\" (UniqueName: \"kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht\") pod \"98d85219-6480-48a1-87cb-ddb28d1288b8\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " Jul 20 22:32:08.204404 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.204409 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file\") pod \"98d85219-6480-48a1-87cb-ddb28d1288b8\" (UID: \"98d85219-6480-48a1-87cb-ddb28d1288b8\") " Jul 20 22:32:08.204971 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.204877 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file" (OuterVolumeSpecName: "config-file") pod "98d85219-6480-48a1-87cb-ddb28d1288b8" (UID: "98d85219-6480-48a1-87cb-ddb28d1288b8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:32:08.206559 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.206527 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht" (OuterVolumeSpecName: "kube-api-access-7vnht") pod "98d85219-6480-48a1-87cb-ddb28d1288b8" (UID: "98d85219-6480-48a1-87cb-ddb28d1288b8"). InnerVolumeSpecName "kube-api-access-7vnht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:32:08.306153 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.306104 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vnht\" (UniqueName: \"kubernetes.io/projected/98d85219-6480-48a1-87cb-ddb28d1288b8-kube-api-access-7vnht\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:32:08.306153 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.306136 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/98d85219-6480-48a1-87cb-ddb28d1288b8-config-file\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:32:08.854305 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.854267 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" Jul 20 22:32:08.854489 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.854301 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tw2kv" event={"ID":"98d85219-6480-48a1-87cb-ddb28d1288b8","Type":"ContainerDied","Data":"0b7f31de66ec894f41448677df88c1de1b327a7535fd4dd25d4fdcd327bd6a8a"} Jul 20 22:32:08.854489 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.854368 2568 scope.go:117] "RemoveContainer" containerID="42200939b0167c91d2beaa5ae9d2969f83764f501abd6887d9cabe1c5f1ed82a" Jul 20 22:32:08.871573 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.871540 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:32:08.875376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:08.875347 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tw2kv"] Jul 20 22:32:10.296408 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:10.296372 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d85219-6480-48a1-87cb-ddb28d1288b8" path="/var/lib/kubelet/pods/98d85219-6480-48a1-87cb-ddb28d1288b8/volumes" Jul 20 22:32:13.487491 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.487458 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cktng"] Jul 20 22:32:13.487892 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.487841 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d85219-6480-48a1-87cb-ddb28d1288b8" containerName="limitador" Jul 20 22:32:13.487892 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.487855 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d85219-6480-48a1-87cb-ddb28d1288b8" containerName="limitador" Jul 20 22:32:13.487965 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.487926 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d85219-6480-48a1-87cb-ddb28d1288b8" containerName="limitador" Jul 20 22:32:13.492631 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.492603 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.495239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.495217 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-g794l\"" Jul 20 22:32:13.496330 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.496313 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 22:32:13.496662 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.496643 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 20 22:32:13.496902 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.496887 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 22:32:13.510434 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.510409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cktng"] Jul 20 22:32:13.550492 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.550454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96nq\" (UniqueName: \"kubernetes.io/projected/d30ec827-ee3f-4293-acfe-197202de9d1d-kube-api-access-q96nq\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.550679 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.550515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d30ec827-ee3f-4293-acfe-197202de9d1d-data\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.651698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.651661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96nq\" (UniqueName: \"kubernetes.io/projected/d30ec827-ee3f-4293-acfe-197202de9d1d-kube-api-access-q96nq\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.651870 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.651716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d30ec827-ee3f-4293-acfe-197202de9d1d-data\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.652118 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.652099 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d30ec827-ee3f-4293-acfe-197202de9d1d-data\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.667136 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.667102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96nq\" (UniqueName: \"kubernetes.io/projected/d30ec827-ee3f-4293-acfe-197202de9d1d-kube-api-access-q96nq\") pod \"postgres-69fb4594cf-cktng\" (UID: \"d30ec827-ee3f-4293-acfe-197202de9d1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.802332 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.802296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:13.946287 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:13.946263 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cktng"] Jul 20 22:32:13.948556 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:32:13.948512 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30ec827_ee3f_4293_acfe_197202de9d1d.slice/crio-158d13497f5b64197dd93cef3a5991324823dd24d32c33f7629a3616e3fce306 WatchSource:0}: Error finding container 158d13497f5b64197dd93cef3a5991324823dd24d32c33f7629a3616e3fce306: Status 404 returned error can't find the container with id 158d13497f5b64197dd93cef3a5991324823dd24d32c33f7629a3616e3fce306 Jul 20 22:32:14.892981 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:14.892933 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" event={"ID":"d30ec827-ee3f-4293-acfe-197202de9d1d","Type":"ContainerStarted","Data":"158d13497f5b64197dd93cef3a5991324823dd24d32c33f7629a3616e3fce306"} Jul 20 22:32:19.926067 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:19.926025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" event={"ID":"d30ec827-ee3f-4293-acfe-197202de9d1d","Type":"ContainerStarted","Data":"c7a8b53477bb8af8393ff0ae09d8834f7822517ad2932a8316656890f199ba95"} Jul 20 22:32:19.926475 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:19.926218 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:19.945885 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:19.945809 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" podStartSLOduration=2.028217923 podStartE2EDuration="6.945783826s" totalImagesPullingTime="4.917565903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:19.942591957 +0000 UTC m=+594.151424884" watchObservedRunningTime="2026-07-20 22:32:19.945783826 +0000 UTC m=+594.154616756" Jul 20 22:32:25.962697 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:25.962664 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cktng" Jul 20 22:32:26.262108 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:26.262006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:32:26.263539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:26.263510 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:32:32.687991 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.687951 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:32.714201 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.714162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:32.714384 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.714290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.717571 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.717548 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 22:32:32.717571 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.717564 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 22:32:32.717772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.717652 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-447ht\"" Jul 20 22:32:32.820735 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.820701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.820735 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.820736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqcr\" (UniqueName: \"kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.868378 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.868342 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:32:32.872109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.872086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:32.883918 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.883895 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:32:32.921936 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.921904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rglnd\" (UniqueName: \"kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:32.922125 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.921961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.922125 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.922012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqcr\" (UniqueName: \"kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.922125 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.922058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:32.924529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.924483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:32.930156 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:32.930128 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqcr\" (UniqueName: \"kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr\") pod \"maas-controller-5cb8bd767b-6nxd6\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:33.022918 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.022828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rglnd\" (UniqueName: \"kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:33.022918 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.022889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:33.025362 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.025326 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:33.025475 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.025420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:33.031577 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.031552 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rglnd\" (UniqueName: \"kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd\") pod \"maas-controller-794dc66cdb-ldbqj\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:33.158731 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.158704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:33.160672 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:32:33.160646 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7777719_c59e_428b_a1d2_b4ea0e5f2fa9.slice/crio-2a150cf3914df74b581e9faddcacb235bbc5b5c0ce16742065b4d0822151de1c WatchSource:0}: Error finding container 2a150cf3914df74b581e9faddcacb235bbc5b5c0ce16742065b4d0822151de1c: Status 404 returned error can't find the container with id 2a150cf3914df74b581e9faddcacb235bbc5b5c0ce16742065b4d0822151de1c Jul 20 22:32:33.183369 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.183341 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:33.317043 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:33.317020 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:32:33.319154 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:32:33.319124 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9acc39e_6741_42c1_9c87_1dd32b94339b.slice/crio-74c36eb38267aefbf773c5a0777bf2cc79caacc8c029a88e5bb77e56656bb91e WatchSource:0}: Error finding container 74c36eb38267aefbf773c5a0777bf2cc79caacc8c029a88e5bb77e56656bb91e: Status 404 returned error can't find the container with id 74c36eb38267aefbf773c5a0777bf2cc79caacc8c029a88e5bb77e56656bb91e Jul 20 22:32:34.005037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:34.004982 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" event={"ID":"c9acc39e-6741-42c1-9c87-1dd32b94339b","Type":"ContainerStarted","Data":"74c36eb38267aefbf773c5a0777bf2cc79caacc8c029a88e5bb77e56656bb91e"} Jul 20 22:32:34.007568 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:34.007537 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" event={"ID":"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9","Type":"ContainerStarted","Data":"2a150cf3914df74b581e9faddcacb235bbc5b5c0ce16742065b4d0822151de1c"} Jul 20 22:32:36.020135 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.020030 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" event={"ID":"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9","Type":"ContainerStarted","Data":"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5"} Jul 20 22:32:36.020597 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.020216 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:36.021628 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.021608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" event={"ID":"c9acc39e-6741-42c1-9c87-1dd32b94339b","Type":"ContainerStarted","Data":"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4"} Jul 20 22:32:36.021702 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.021663 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:36.064372 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.064319 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" podStartSLOduration=1.4806328739999999 podStartE2EDuration="4.06430378s" totalImagesPullingTime="2.583670906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:36.058472408 +0000 UTC m=+610.267305356" watchObservedRunningTime="2026-07-20 22:32:36.06430378 +0000 UTC m=+610.273136709" Jul 20 22:32:36.133043 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:36.132985 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" podStartSLOduration=1.697449428 podStartE2EDuration="4.132967772s" totalImagesPullingTime="2.435518344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:36.13101133 +0000 UTC m=+610.339844278" watchObservedRunningTime="2026-07-20 22:32:36.132967772 +0000 UTC m=+610.341800701" Jul 20 22:32:47.030162 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.030130 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:47.032719 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.030198 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:32:47.126694 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.126655 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:47.126885 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.126859 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" podUID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" containerName="manager" containerID="cri-o://5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5" gracePeriod=30 Jul 20 22:32:47.369109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.369081 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:47.448740 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.448704 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxqcr\" (UniqueName: \"kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr\") pod \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " Jul 20 22:32:47.448740 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.448745 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert\") pod \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\" (UID: \"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9\") " Jul 20 22:32:47.451561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.451530 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" (UID: "f7777719-c59e-428b-a1d2-b4ea0e5f2fa9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:32:47.451561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.451530 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr" (OuterVolumeSpecName: "kube-api-access-wxqcr") pod "f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" (UID: "f7777719-c59e-428b-a1d2-b4ea0e5f2fa9"). InnerVolumeSpecName "kube-api-access-wxqcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:32:47.549794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.549766 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxqcr\" (UniqueName: \"kubernetes.io/projected/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-kube-api-access-wxqcr\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:32:47.549794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:47.549795 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9-webhook-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:32:48.088760 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.088718 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" containerID="5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5" exitCode=0 Jul 20 22:32:48.089244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.088772 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" Jul 20 22:32:48.089244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.088786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" event={"ID":"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9","Type":"ContainerDied","Data":"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5"} Jul 20 22:32:48.089244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.088852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb8bd767b-6nxd6" event={"ID":"f7777719-c59e-428b-a1d2-b4ea0e5f2fa9","Type":"ContainerDied","Data":"2a150cf3914df74b581e9faddcacb235bbc5b5c0ce16742065b4d0822151de1c"} Jul 20 22:32:48.089244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.088887 2568 scope.go:117] "RemoveContainer" containerID="5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5" Jul 20 22:32:48.097817 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.097797 2568 scope.go:117] "RemoveContainer" containerID="5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5" Jul 20 22:32:48.098089 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:32:48.098070 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5\": container with ID starting with 5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5 not found: ID does not exist" containerID="5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5" Jul 20 22:32:48.098138 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.098097 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5"} err="failed to get container status \"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5\": rpc error: code = NotFound desc = could not find container \"5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5\": container with ID starting with 5016c0bf19026b713ec06c1d87c343e1c901447cef6cdafeaaa28efff4313ca5 not found: ID does not exist" Jul 20 22:32:48.111974 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.111944 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:48.116270 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.116247 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cb8bd767b-6nxd6"] Jul 20 22:32:48.296662 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:32:48.296630 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" path="/var/lib/kubelet/pods/f7777719-c59e-428b-a1d2-b4ea0e5f2fa9/volumes" Jul 20 22:33:06.608934 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.608896 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-pdlb4"] Jul 20 22:33:06.609531 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.609464 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" containerName="manager" Jul 20 22:33:06.609531 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.609487 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" containerName="manager" Jul 20 22:33:06.609678 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.609590 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7777719-c59e-428b-a1d2-b4ea0e5f2fa9" containerName="manager" Jul 20 22:33:06.612814 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.612791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.615835 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.615814 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 22:33:06.617007 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.616986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qtn\" (UniqueName: \"kubernetes.io/projected/36884052-c028-4828-a806-cd89d25ce7cd-kube-api-access-g2qtn\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.617102 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.617028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36884052-c028-4828-a806-cd89d25ce7cd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.625142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.625118 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-pdlb4"] Jul 20 22:33:06.669758 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.669724 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t4hf4"] Jul 20 22:33:06.673076 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.673059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.676612 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.676584 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fw9kh\"" Jul 20 22:33:06.685751 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.685727 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t4hf4"] Jul 20 22:33:06.718073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.718038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2f68\" (UniqueName: \"kubernetes.io/projected/186771ae-c742-409e-a72c-0f3c28044d48-kube-api-access-s2f68\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.718301 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.718102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qtn\" (UniqueName: \"kubernetes.io/projected/36884052-c028-4828-a806-cd89d25ce7cd-kube-api-access-g2qtn\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.718383 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.718307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36884052-c028-4828-a806-cd89d25ce7cd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.718451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.718393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186771ae-c742-409e-a72c-0f3c28044d48-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.718995 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.718976 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36884052-c028-4828-a806-cd89d25ce7cd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.738894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.738859 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qtn\" (UniqueName: \"kubernetes.io/projected/36884052-c028-4828-a806-cd89d25ce7cd-kube-api-access-g2qtn\") pod \"payload-processing-5bf47cd988-pdlb4\" (UID: \"36884052-c028-4828-a806-cd89d25ce7cd\") " pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.819140 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.819097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2f68\" (UniqueName: \"kubernetes.io/projected/186771ae-c742-409e-a72c-0f3c28044d48-kube-api-access-s2f68\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.819337 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.819234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186771ae-c742-409e-a72c-0f3c28044d48-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.819906 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.819880 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186771ae-c742-409e-a72c-0f3c28044d48-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.828948 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.828918 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2f68\" (UniqueName: \"kubernetes.io/projected/186771ae-c742-409e-a72c-0f3c28044d48-kube-api-access-s2f68\") pod \"payload-pre-processing-7677b774bb-t4hf4\" (UID: \"186771ae-c742-409e-a72c-0f3c28044d48\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:06.923667 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.923592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:06.983052 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:06.983013 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:07.075493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:07.075468 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-pdlb4"] Jul 20 22:33:07.077478 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:33:07.077448 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36884052_c028_4828_a806_cd89d25ce7cd.slice/crio-9c94becdc74444d8f111e13634de56188b48c7ec958f92398273d0045fd1e925 WatchSource:0}: Error finding container 9c94becdc74444d8f111e13634de56188b48c7ec958f92398273d0045fd1e925: Status 404 returned error can't find the container with id 9c94becdc74444d8f111e13634de56188b48c7ec958f92398273d0045fd1e925 Jul 20 22:33:07.079650 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:07.079632 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 22:33:07.134182 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:07.134158 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t4hf4"] Jul 20 22:33:07.136001 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:33:07.135974 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186771ae_c742_409e_a72c_0f3c28044d48.slice/crio-8ed177388213ae4b0aa49ab650c4420952f17210781fd120b4279eb5c5b9f453 WatchSource:0}: Error finding container 8ed177388213ae4b0aa49ab650c4420952f17210781fd120b4279eb5c5b9f453: Status 404 returned error can't find the container with id 8ed177388213ae4b0aa49ab650c4420952f17210781fd120b4279eb5c5b9f453 Jul 20 22:33:07.193035 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:07.192939 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" event={"ID":"186771ae-c742-409e-a72c-0f3c28044d48","Type":"ContainerStarted","Data":"8ed177388213ae4b0aa49ab650c4420952f17210781fd120b4279eb5c5b9f453"} Jul 20 22:33:07.194377 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:07.194350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" event={"ID":"36884052-c028-4828-a806-cd89d25ce7cd","Type":"ContainerStarted","Data":"9c94becdc74444d8f111e13634de56188b48c7ec958f92398273d0045fd1e925"} Jul 20 22:33:10.236910 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.236868 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" event={"ID":"186771ae-c742-409e-a72c-0f3c28044d48","Type":"ContainerStarted","Data":"b53db6d7e2c9ee3067dca0d29c14abbf02ba11da36ff413db3d0225643f74e7a"} Jul 20 22:33:10.237595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.236950 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:10.238443 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.238417 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" event={"ID":"36884052-c028-4828-a806-cd89d25ce7cd","Type":"ContainerStarted","Data":"08f203afd49511429101b4c97086c6b213036bcf8c8dfae903c78b81c463fa3b"} Jul 20 22:33:10.238562 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.238469 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:10.252372 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.252312 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" podStartSLOduration=2.18809984 podStartE2EDuration="4.252293888s" totalImagesPullingTime="2.064194048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:10.251885969 +0000 UTC m=+644.460718899" watchObservedRunningTime="2026-07-20 22:33:10.252293888 +0000 UTC m=+644.461126818" Jul 20 22:33:10.267967 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:10.267911 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" podStartSLOduration=2.150958286 podStartE2EDuration="4.267894108s" totalImagesPullingTime="2.116935822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:10.266423468 +0000 UTC m=+644.475256397" watchObservedRunningTime="2026-07-20 22:33:10.267894108 +0000 UTC m=+644.476727037" Jul 20 22:33:14.261828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.261788 2568 generic.go:356] "Generic (PLEG): container finished" podID="79d04105-61e3-4f26-84ee-c5306c8121a4" containerID="7864ebf72ab8f9b8ce819444d993a8ccf41ff6a33d7a6bedcda4400752125085" exitCode=0 Jul 20 22:33:14.262248 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.261863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" event={"ID":"79d04105-61e3-4f26-84ee-c5306c8121a4","Type":"ContainerDied","Data":"7864ebf72ab8f9b8ce819444d993a8ccf41ff6a33d7a6bedcda4400752125085"} Jul 20 22:33:14.262292 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.262248 2568 scope.go:117] "RemoveContainer" containerID="7864ebf72ab8f9b8ce819444d993a8ccf41ff6a33d7a6bedcda4400752125085" Jul 20 22:33:14.263209 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.263179 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:33:14.263307 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.263265 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:33:14.263371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:14.263316 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:33:15.269220 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:15.269178 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" event={"ID":"79d04105-61e3-4f26-84ee-c5306c8121a4","Type":"ContainerStarted","Data":"bc10abdec2df822994f2510ca5ee7920df77324e23f725fdd89afdafd041e534"} Jul 20 22:33:15.390792 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:15.390760 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:33:15.391356 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:15.391332 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4xhjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 20 22:33:15.391404 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:15.391387 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" podUID="79d04105-61e3-4f26-84ee-c5306c8121a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 20 22:33:16.390696 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:16.390659 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4xhjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 20 22:33:16.391095 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:16.390731 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" podUID="79d04105-61e3-4f26-84ee-c5306c8121a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 20 22:33:17.390996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:17.390956 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4xhjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 20 22:33:17.391392 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:17.391023 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" podUID="79d04105-61e3-4f26-84ee-c5306c8121a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 20 22:33:18.390322 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:18.390281 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4xhjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 20 22:33:18.390535 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:18.390355 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" podUID="79d04105-61e3-4f26-84ee-c5306c8121a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 20 22:33:19.393938 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:19.393897 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:33:19.394376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:19.394357 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:33:19.395123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:19.395102 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4xhjq" Jul 20 22:33:21.246091 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:21.246058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-t4hf4" Jul 20 22:33:21.246551 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:21.246133 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-pdlb4" Jul 20 22:33:27.396700 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.396665 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m"] Jul 20 22:33:27.401278 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.401260 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.405162 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.405135 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z682z\"" Jul 20 22:33:27.405302 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.405197 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 22:33:27.405302 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.405241 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 22:33:27.405302 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.405270 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 20 22:33:27.425883 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.425853 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m"] Jul 20 22:33:27.512128 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crhb\" (UniqueName: \"kubernetes.io/projected/71c7d7e4-a90f-4165-8692-4a364c721f48-kube-api-access-8crhb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.512325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.512325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.512325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.512325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.512599 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.512389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c7d7e4-a90f-4165-8692-4a364c721f48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crhb\" (UniqueName: \"kubernetes.io/projected/71c7d7e4-a90f-4165-8692-4a364c721f48-kube-api-access-8crhb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c7d7e4-a90f-4165-8692-4a364c721f48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613753 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613815 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613793 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.613905 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.613881 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.615593 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.615574 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c7d7e4-a90f-4165-8692-4a364c721f48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.615977 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.615960 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c7d7e4-a90f-4165-8692-4a364c721f48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.622542 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.622519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crhb\" (UniqueName: \"kubernetes.io/projected/71c7d7e4-a90f-4165-8692-4a364c721f48-kube-api-access-8crhb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m\" (UID: \"71c7d7e4-a90f-4165-8692-4a364c721f48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.711755 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.711669 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:27.872257 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:27.872230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m"] Jul 20 22:33:27.873436 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:33:27.873406 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c7d7e4_a90f_4165_8692_4a364c721f48.slice/crio-05bb2e87be1e09f3aa7e3744cb6a97c25405c445dc0e6f392ca0ab5f94330e31 WatchSource:0}: Error finding container 05bb2e87be1e09f3aa7e3744cb6a97c25405c445dc0e6f392ca0ab5f94330e31: Status 404 returned error can't find the container with id 05bb2e87be1e09f3aa7e3744cb6a97c25405c445dc0e6f392ca0ab5f94330e31 Jul 20 22:33:28.351295 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:28.351254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" event={"ID":"71c7d7e4-a90f-4165-8692-4a364c721f48","Type":"ContainerStarted","Data":"05bb2e87be1e09f3aa7e3744cb6a97c25405c445dc0e6f392ca0ab5f94330e31"} Jul 20 22:33:29.358462 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:29.358406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" event={"ID":"71c7d7e4-a90f-4165-8692-4a364c721f48","Type":"ContainerStarted","Data":"d56aad35415d6dce6631b6901b3bbb61f4216025ef9ff62cf920b41b7785ce8a"} Jul 20 22:33:29.378693 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:29.378625 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" podStartSLOduration=1.254481475 podStartE2EDuration="2.378607819s" totalImagesPullingTime="1.124126344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:29.377455254 +0000 UTC m=+663.586288183" watchObservedRunningTime="2026-07-20 22:33:29.378607819 +0000 UTC m=+663.587440782" Jul 20 22:33:37.712446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:37.712405 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:37.712950 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:37.712469 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:37.725269 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:37.725238 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:38.415665 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:38.415636 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m" Jul 20 22:33:51.199447 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.199415 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5"] Jul 20 22:33:51.203024 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.203006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.205553 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.205524 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 22:33:51.212948 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.212921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5"] Jul 20 22:33:51.226376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.226556 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.226556 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4c5j\" (UniqueName: \"kubernetes.io/projected/5116a772-41a5-4f33-88c1-7092a5ec8462-kube-api-access-z4c5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.226556 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226471 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.226556 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.226811 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.226576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5116a772-41a5-4f33-88c1-7092a5ec8462-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327011 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.326968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327195 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327195 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5116a772-41a5-4f33-88c1-7092a5ec8462-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327195 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327367 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327367 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4c5j\" (UniqueName: \"kubernetes.io/projected/5116a772-41a5-4f33-88c1-7092a5ec8462-kube-api-access-z4c5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327486 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327385 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327594 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327549 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.327659 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.327634 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.329473 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.329449 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5116a772-41a5-4f33-88c1-7092a5ec8462-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.329636 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.329616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5116a772-41a5-4f33-88c1-7092a5ec8462-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.337851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.337826 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4c5j\" (UniqueName: \"kubernetes.io/projected/5116a772-41a5-4f33-88c1-7092a5ec8462-kube-api-access-z4c5j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wssx5\" (UID: \"5116a772-41a5-4f33-88c1-7092a5ec8462\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.514078 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.513987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:33:51.664044 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:51.664011 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5"] Jul 20 22:33:51.665695 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:33:51.665669 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5116a772_41a5_4f33_88c1_7092a5ec8462.slice/crio-f6c98e306c174a9634b74f16df90e58b828f6ce313d70c291a81ec2304faea41 WatchSource:0}: Error finding container f6c98e306c174a9634b74f16df90e58b828f6ce313d70c291a81ec2304faea41: Status 404 returned error can't find the container with id f6c98e306c174a9634b74f16df90e58b828f6ce313d70c291a81ec2304faea41 Jul 20 22:33:52.479599 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:52.479559 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" event={"ID":"5116a772-41a5-4f33-88c1-7092a5ec8462","Type":"ContainerStarted","Data":"984344ac4615af4bba08348f4cd6ebf614bfaa6ae9ca298d884e54c2057e3ec4"} Jul 20 22:33:52.480076 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:52.479622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" event={"ID":"5116a772-41a5-4f33-88c1-7092a5ec8462","Type":"ContainerStarted","Data":"f6c98e306c174a9634b74f16df90e58b828f6ce313d70c291a81ec2304faea41"} Jul 20 22:33:52.497271 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:33:52.497225 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" podStartSLOduration=1.3064236679999999 podStartE2EDuration="1.497209804s" totalImagesPullingTime="190.786136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:52.496715108 +0000 UTC m=+686.705548039" watchObservedRunningTime="2026-07-20 22:33:52.497209804 +0000 UTC m=+686.706042733" Jul 20 22:34:01.514267 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:34:01.514234 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:34:01.514799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:34:01.514331 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:34:01.527120 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:34:01.527091 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:34:01.539427 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:34:01.539405 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wssx5" Jul 20 22:36:27.975421 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:27.975377 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:36:27.976013 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:27.975728 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" podUID="c9acc39e-6741-42c1-9c87-1dd32b94339b" containerName="manager" containerID="cri-o://5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4" gracePeriod=30 Jul 20 22:36:28.229602 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.229531 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:36:28.296536 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.296481 2568 generic.go:356] "Generic (PLEG): container finished" podID="c9acc39e-6741-42c1-9c87-1dd32b94339b" containerID="5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4" exitCode=0 Jul 20 22:36:28.296685 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.296597 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" Jul 20 22:36:28.299451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.299425 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" event={"ID":"c9acc39e-6741-42c1-9c87-1dd32b94339b","Type":"ContainerDied","Data":"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4"} Jul 20 22:36:28.299575 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.299487 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-ldbqj" event={"ID":"c9acc39e-6741-42c1-9c87-1dd32b94339b","Type":"ContainerDied","Data":"74c36eb38267aefbf773c5a0777bf2cc79caacc8c029a88e5bb77e56656bb91e"} Jul 20 22:36:28.299575 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.299522 2568 scope.go:117] "RemoveContainer" containerID="5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4" Jul 20 22:36:28.308044 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.308024 2568 scope.go:117] "RemoveContainer" containerID="5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4" Jul 20 22:36:28.308306 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:36:28.308285 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4\": container with ID starting with 5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4 not found: ID does not exist" containerID="5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4" Jul 20 22:36:28.308357 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.308318 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4"} err="failed to get container status \"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4\": rpc error: code = NotFound desc = could not find container \"5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4\": container with ID starting with 5bd4c703193e64927935dd9cc10d608e5634fd20f9be2031cd76b719084e3fb4 not found: ID does not exist" Jul 20 22:36:28.329806 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.329770 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rglnd\" (UniqueName: \"kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd\") pod \"c9acc39e-6741-42c1-9c87-1dd32b94339b\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " Jul 20 22:36:28.329949 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.329839 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert\") pod \"c9acc39e-6741-42c1-9c87-1dd32b94339b\" (UID: \"c9acc39e-6741-42c1-9c87-1dd32b94339b\") " Jul 20 22:36:28.331975 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.331946 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c9acc39e-6741-42c1-9c87-1dd32b94339b" (UID: "c9acc39e-6741-42c1-9c87-1dd32b94339b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:36:28.332031 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.332005 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd" (OuterVolumeSpecName: "kube-api-access-rglnd") pod "c9acc39e-6741-42c1-9c87-1dd32b94339b" (UID: "c9acc39e-6741-42c1-9c87-1dd32b94339b"). InnerVolumeSpecName "kube-api-access-rglnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:36:28.431210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.431169 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9acc39e-6741-42c1-9c87-1dd32b94339b-webhook-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:36:28.431210 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.431205 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rglnd\" (UniqueName: \"kubernetes.io/projected/c9acc39e-6741-42c1-9c87-1dd32b94339b-kube-api-access-rglnd\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:36:28.619336 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.619304 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:36:28.623780 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:28.623750 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-ldbqj"] Jul 20 22:36:30.297409 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:36:30.297376 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9acc39e-6741-42c1-9c87-1dd32b94339b" path="/var/lib/kubelet/pods/c9acc39e-6741-42c1-9c87-1dd32b94339b/volumes" Jul 20 22:37:26.300752 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:26.300673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:37:26.303199 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:26.303176 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:37:29.422644 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.422608 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:29.423159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.423140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9acc39e-6741-42c1-9c87-1dd32b94339b" containerName="manager" Jul 20 22:37:29.423242 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.423162 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9acc39e-6741-42c1-9c87-1dd32b94339b" containerName="manager" Jul 20 22:37:29.423323 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.423310 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9acc39e-6741-42c1-9c87-1dd32b94339b" containerName="manager" Jul 20 22:37:29.427645 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.427626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.430391 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.430374 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 22:37:29.430481 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.430378 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 22:37:29.431004 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.430990 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-447ht\"" Jul 20 22:37:29.435445 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.435419 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:29.466214 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.466187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.466365 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.466226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvczn\" (UniqueName: \"kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.567266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.567235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.567413 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.567276 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvczn\" (UniqueName: \"kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.569670 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.569643 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.576159 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.576136 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvczn\" (UniqueName: \"kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn\") pod \"maas-controller-794dc66cdb-5hljl\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.739622 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.739548 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:29.873133 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:29.873108 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:29.874827 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:37:29.874798 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d276f84_ba95_4654_9f75_4f08731e94b0.slice/crio-7464ea7a17870ce0ff250507240577151f6c061f2fb4feefed8814bfb460a6a8 WatchSource:0}: Error finding container 7464ea7a17870ce0ff250507240577151f6c061f2fb4feefed8814bfb460a6a8: Status 404 returned error can't find the container with id 7464ea7a17870ce0ff250507240577151f6c061f2fb4feefed8814bfb460a6a8 Jul 20 22:37:30.634935 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:30.634909 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-5hljl" event={"ID":"1d276f84-ba95-4654-9f75-4f08731e94b0","Type":"ContainerStarted","Data":"7464ea7a17870ce0ff250507240577151f6c061f2fb4feefed8814bfb460a6a8"} Jul 20 22:37:31.641737 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:31.641701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-5hljl" event={"ID":"1d276f84-ba95-4654-9f75-4f08731e94b0","Type":"ContainerStarted","Data":"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c"} Jul 20 22:37:31.642215 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:31.641768 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:31.658947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:31.658897 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-794dc66cdb-5hljl" podStartSLOduration=1.9503357829999999 podStartE2EDuration="2.658882129s" totalImagesPullingTime="708.546346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:37:31.658459011 +0000 UTC m=+905.867291940" watchObservedRunningTime="2026-07-20 22:37:31.658882129 +0000 UTC m=+905.867715058" Jul 20 22:37:42.648022 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:42.647995 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:47.285211 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.285170 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:47.285794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.285380 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-794dc66cdb-5hljl" podUID="1d276f84-ba95-4654-9f75-4f08731e94b0" containerName="manager" containerID="cri-o://55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c" gracePeriod=30 Jul 20 22:37:47.526072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.526047 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:47.629153 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.629109 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert\") pod \"1d276f84-ba95-4654-9f75-4f08731e94b0\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " Jul 20 22:37:47.629336 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.629219 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvczn\" (UniqueName: \"kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn\") pod \"1d276f84-ba95-4654-9f75-4f08731e94b0\" (UID: \"1d276f84-ba95-4654-9f75-4f08731e94b0\") " Jul 20 22:37:47.631254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.631217 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d276f84-ba95-4654-9f75-4f08731e94b0" (UID: "1d276f84-ba95-4654-9f75-4f08731e94b0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 22:37:47.631371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.631263 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn" (OuterVolumeSpecName: "kube-api-access-hvczn") pod "1d276f84-ba95-4654-9f75-4f08731e94b0" (UID: "1d276f84-ba95-4654-9f75-4f08731e94b0"). InnerVolumeSpecName "kube-api-access-hvczn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:37:47.725811 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.725775 2568 generic.go:356] "Generic (PLEG): container finished" podID="1d276f84-ba95-4654-9f75-4f08731e94b0" containerID="55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c" exitCode=0 Jul 20 22:37:47.725989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.725822 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-5hljl" Jul 20 22:37:47.725989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.725858 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-5hljl" event={"ID":"1d276f84-ba95-4654-9f75-4f08731e94b0","Type":"ContainerDied","Data":"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c"} Jul 20 22:37:47.725989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.725912 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-5hljl" event={"ID":"1d276f84-ba95-4654-9f75-4f08731e94b0","Type":"ContainerDied","Data":"7464ea7a17870ce0ff250507240577151f6c061f2fb4feefed8814bfb460a6a8"} Jul 20 22:37:47.725989 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.725934 2568 scope.go:117] "RemoveContainer" containerID="55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c" Jul 20 22:37:47.729956 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.729931 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d276f84-ba95-4654-9f75-4f08731e94b0-webhook-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:37:47.729956 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.729954 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvczn\" (UniqueName: \"kubernetes.io/projected/1d276f84-ba95-4654-9f75-4f08731e94b0-kube-api-access-hvczn\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:37:47.735611 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.735590 2568 scope.go:117] "RemoveContainer" containerID="55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c" Jul 20 22:37:47.735861 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:37:47.735841 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c\": container with ID starting with 55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c not found: ID does not exist" containerID="55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c" Jul 20 22:37:47.735924 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.735869 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c"} err="failed to get container status \"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c\": rpc error: code = NotFound desc = could not find container \"55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c\": container with ID starting with 55fc840ead41612c73078f5703323fa29d5384982ca26bcb11fb634967406a7c not found: ID does not exist" Jul 20 22:37:47.748256 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.748233 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:47.752929 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:47.752910 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-5hljl"] Jul 20 22:37:48.297031 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.296998 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d276f84-ba95-4654-9f75-4f08731e94b0" path="/var/lib/kubelet/pods/1d276f84-ba95-4654-9f75-4f08731e94b0/volumes" Jul 20 22:37:48.525856 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.525821 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-794dc66cdb-rh5rs"] Jul 20 22:37:48.526224 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.526210 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d276f84-ba95-4654-9f75-4f08731e94b0" containerName="manager" Jul 20 22:37:48.526267 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.526225 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d276f84-ba95-4654-9f75-4f08731e94b0" containerName="manager" Jul 20 22:37:48.526302 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.526289 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d276f84-ba95-4654-9f75-4f08731e94b0" containerName="manager" Jul 20 22:37:48.530661 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.530638 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.532712 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.532692 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 22:37:48.533457 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.533441 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 22:37:48.533572 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.533443 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-447ht\"" Jul 20 22:37:48.539170 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.539148 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-rh5rs"] Jul 20 22:37:48.637925 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.637835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e038aad-b278-46c6-8453-8130005257a6-webhook-cert\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.637925 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.637881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnttq\" (UniqueName: \"kubernetes.io/projected/5e038aad-b278-46c6-8453-8130005257a6-kube-api-access-jnttq\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.738649 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.738619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e038aad-b278-46c6-8453-8130005257a6-webhook-cert\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.738814 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.738662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnttq\" (UniqueName: \"kubernetes.io/projected/5e038aad-b278-46c6-8453-8130005257a6-kube-api-access-jnttq\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.741122 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.741102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e038aad-b278-46c6-8453-8130005257a6-webhook-cert\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.748995 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.748968 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnttq\" (UniqueName: \"kubernetes.io/projected/5e038aad-b278-46c6-8453-8130005257a6-kube-api-access-jnttq\") pod \"maas-controller-794dc66cdb-rh5rs\" (UID: \"5e038aad-b278-46c6-8453-8130005257a6\") " pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.842813 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.842779 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:48.979917 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:48.979890 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dc66cdb-rh5rs"] Jul 20 22:37:48.981779 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:37:48.981750 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e038aad_b278_46c6_8453_8130005257a6.slice/crio-c92d281a3fe1ddac1fc95ae2c6fe632e3a0104029ca6c68d79a21d811102b903 WatchSource:0}: Error finding container c92d281a3fe1ddac1fc95ae2c6fe632e3a0104029ca6c68d79a21d811102b903: Status 404 returned error can't find the container with id c92d281a3fe1ddac1fc95ae2c6fe632e3a0104029ca6c68d79a21d811102b903 Jul 20 22:37:49.738724 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:49.738630 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" event={"ID":"5e038aad-b278-46c6-8453-8130005257a6","Type":"ContainerStarted","Data":"57ec422e049d4b8f763fb4beda777f34a00ed6dde550cb303bcb44e5a7828c63"} Jul 20 22:37:49.738724 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:49.738685 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" event={"ID":"5e038aad-b278-46c6-8453-8130005257a6","Type":"ContainerStarted","Data":"c92d281a3fe1ddac1fc95ae2c6fe632e3a0104029ca6c68d79a21d811102b903"} Jul 20 22:37:49.739115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:49.738732 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:37:49.756020 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:37:49.755972 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" podStartSLOduration=1.3962247749999999 podStartE2EDuration="1.755956572s" totalImagesPullingTime="359.731797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:37:49.753703565 +0000 UTC m=+923.962536506" watchObservedRunningTime="2026-07-20 22:37:49.755956572 +0000 UTC m=+923.964789546" Jul 20 22:38:00.746102 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:38:00.746070 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-794dc66cdb-rh5rs" Jul 20 22:42:26.338050 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:42:26.338009 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:42:26.341404 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:42:26.341383 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:45:00.162954 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.160081 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988"] Jul 20 22:45:00.165259 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.165237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" Jul 20 22:45:00.167879 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.167859 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4f4tw\"" Jul 20 22:45:00.172388 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.172358 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988"] Jul 20 22:45:00.176749 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.176728 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" Jul 20 22:45:00.313903 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.313881 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988"] Jul 20 22:45:00.315315 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:45:00.315283 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1d2ea0_108c_4bcd_b937_ba6020dd2dbc.slice/crio-95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f WatchSource:0}: Error finding container 95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f: Status 404 returned error can't find the container with id 95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f Jul 20 22:45:00.317072 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:00.317055 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 22:45:01.027861 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:01.027819 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" event={"ID":"fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc","Type":"ContainerStarted","Data":"95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f"} Jul 20 22:45:03.040034 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:03.039943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" event={"ID":"fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc","Type":"ContainerStarted","Data":"b33bf6935c4c2bd5feae30a88c5321f39080c9a7dcedccdadbbadf62cb8ceb08"} Jul 20 22:45:03.064040 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:03.063984 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" podStartSLOduration=1.026464777 podStartE2EDuration="3.063967661s" totalImagesPullingTime="2.037502884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:45:03.061374135 +0000 UTC m=+1357.270207063" watchObservedRunningTime="2026-07-20 22:45:03.063967661 +0000 UTC m=+1357.272800590" Jul 20 22:45:04.046258 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:04.046223 2568 generic.go:356] "Generic (PLEG): container finished" podID="fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc" containerID="b33bf6935c4c2bd5feae30a88c5321f39080c9a7dcedccdadbbadf62cb8ceb08" exitCode=0 Jul 20 22:45:04.046698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:04.046266 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" event={"ID":"fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc","Type":"ContainerDied","Data":"b33bf6935c4c2bd5feae30a88c5321f39080c9a7dcedccdadbbadf62cb8ceb08"} Jul 20 22:45:05.184356 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:05.184329 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" Jul 20 22:45:06.058454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:06.058417 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" Jul 20 22:45:06.058454 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:06.058445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-jf988" event={"ID":"fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc","Type":"ContainerDied","Data":"95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f"} Jul 20 22:45:06.058763 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:45:06.058543 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95bfc7e828dd6bdcdcd519f35371e662629d17f122349aee23229a4ddc9da65f" Jul 20 22:47:26.377516 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:47:26.377469 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:47:26.383244 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:47:26.383216 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:50:42.518284 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.518248 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:50:42.520752 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.518644 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc" containerName="cleanup" Jul 20 22:50:42.520752 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.518656 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc" containerName="cleanup" Jul 20 22:50:42.520752 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.518734 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc" containerName="cleanup" Jul 20 22:50:42.521693 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.521677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.525109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.525089 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-23458506-openshift-default-dockercfg-czhvz\"" Jul 20 22:50:42.549564 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.549518 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:50:42.711350 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711350 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711353 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zng\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.711802 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.711603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zng\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.812958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812946 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.813078 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.812959 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.813135 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.813106 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.813214 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.813191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.813321 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.813301 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.814847 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.814827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.814912 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.814853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.821992 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.821969 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.822207 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.822182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zng\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng\") pod \"e2e-ait-23458506-openshift-default-b458bd949-trprc\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.832001 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.831981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:42.974849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.974816 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:50:42.976133 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:50:42.976106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79b37ba_5c46_4d6c_8e52_9b4e1c2593ef.slice/crio-f8d8de8cb901b040a01dc6d9a6ec98d30f293b63351ddee81c781d74c04b1822 WatchSource:0}: Error finding container f8d8de8cb901b040a01dc6d9a6ec98d30f293b63351ddee81c781d74c04b1822: Status 404 returned error can't find the container with id f8d8de8cb901b040a01dc6d9a6ec98d30f293b63351ddee81c781d74c04b1822 Jul 20 22:50:42.978399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.978366 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:42.978493 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.978446 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:42.978572 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:42.978490 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:43.877251 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:43.877216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerStarted","Data":"1ffd41d90f9636491d945ca5f97d84e3edf547a3620d190b80d984f72e896cc3"} Jul 20 22:50:43.877679 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:43.877266 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerStarted","Data":"f8d8de8cb901b040a01dc6d9a6ec98d30f293b63351ddee81c781d74c04b1822"} Jul 20 22:50:43.902608 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:43.902563 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" podStartSLOduration=1.90254777 podStartE2EDuration="1.90254777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:50:43.9004599 +0000 UTC m=+1698.109292831" watchObservedRunningTime="2026-07-20 22:50:43.90254777 +0000 UTC m=+1698.111380699" Jul 20 22:50:44.832320 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:44.832278 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:44.837186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:44.837157 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:44.882295 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:44.882260 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:44.883173 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:44.883155 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:58.966583 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.966545 2568 generic.go:356] "Generic (PLEG): container finished" podID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerID="1ffd41d90f9636491d945ca5f97d84e3edf547a3620d190b80d984f72e896cc3" exitCode=0 Jul 20 22:50:58.967023 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.966621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerDied","Data":"1ffd41d90f9636491d945ca5f97d84e3edf547a3620d190b80d984f72e896cc3"} Jul 20 22:50:58.967023 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.966985 2568 scope.go:117] "RemoveContainer" containerID="1ffd41d90f9636491d945ca5f97d84e3edf547a3620d190b80d984f72e896cc3" Jul 20 22:50:58.968024 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.967993 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:58.968105 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.968086 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:58.968157 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:58.968138 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:50:59.882489 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:59.882443 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:50:59.975073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:50:59.975035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerStarted","Data":"ab7b1607e93719f69ff97243b27d16cc4c05f6769f20d1c2bf6833bf115b4200"} Jul 20 22:51:00.832965 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:00.832921 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:00.834301 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:00.834272 2568 patch_prober.go:28] interesting pod/e2e-ait-23458506-openshift-default-b458bd949-trprc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 22:51:00.834446 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:00.834326 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 22:51:01.832772 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:01.832733 2568 patch_prober.go:28] interesting pod/e2e-ait-23458506-openshift-default-b458bd949-trprc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 22:51:01.833183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:01.832789 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 22:51:02.833408 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:02.833365 2568 patch_prober.go:28] interesting pod/e2e-ait-23458506-openshift-default-b458bd949-trprc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 22:51:02.833835 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:02.833426 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 22:51:03.837145 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:03.837106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:03.837658 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:03.837521 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:03.838298 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:03.838277 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:25.989404 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:25.989370 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:51:25.989951 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:25.989585 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" containerID="cri-o://ab7b1607e93719f69ff97243b27d16cc4c05f6769f20d1c2bf6833bf115b4200" gracePeriod=30 Jul 20 22:51:26.981813 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:26.981780 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:51:26.985721 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:26.985697 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:26.987987 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:26.987961 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-55938262-gw-openshift-default-dockercfg-z5xzw\"" Jul 20 22:51:26.996448 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:26.996418 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:51:27.152568 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.152803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.152803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.152803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.152803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.152803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.153045 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.153045 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.153045 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.152923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl2t6\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253526 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253526 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253526 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.253819 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254033 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl2t6\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254033 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254033 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254033 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254033 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.253969 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254284 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.254264 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.254491 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.254472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.256131 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.256110 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.256286 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.256270 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.261372 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.261349 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.261796 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.261780 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl2t6\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6\") pod \"e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.298099 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.298070 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:27.445825 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.445794 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:51:27.447065 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:51:27.447038 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7b1c1d_6352_462b_b269_cc72c6e28a78.slice/crio-0047b8747a01cdfc2300b83b4065bc4f3afd53665be34f98e3834ebaa9ad1f2f WatchSource:0}: Error finding container 0047b8747a01cdfc2300b83b4065bc4f3afd53665be34f98e3834ebaa9ad1f2f: Status 404 returned error can't find the container with id 0047b8747a01cdfc2300b83b4065bc4f3afd53665be34f98e3834ebaa9ad1f2f Jul 20 22:51:27.449455 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.449418 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:27.449552 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.449494 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:27.449595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:27.449581 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:28.139557 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:28.139489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerStarted","Data":"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55"} Jul 20 22:51:28.139954 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:28.139581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerStarted","Data":"0047b8747a01cdfc2300b83b4065bc4f3afd53665be34f98e3834ebaa9ad1f2f"} Jul 20 22:51:28.162079 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:28.162021 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podStartSLOduration=2.162005527 podStartE2EDuration="2.162005527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:51:28.158574438 +0000 UTC m=+1742.367407379" watchObservedRunningTime="2026-07-20 22:51:28.162005527 +0000 UTC m=+1742.370838455" Jul 20 22:51:28.298972 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:28.298944 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:28.303640 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:28.303615 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:29.145133 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:29.145102 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:29.146260 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:29.146236 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:31.158841 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.158798 2568 generic.go:356] "Generic (PLEG): container finished" podID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerID="ab7b1607e93719f69ff97243b27d16cc4c05f6769f20d1c2bf6833bf115b4200" exitCode=0 Jul 20 22:51:31.159238 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.158930 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerDied","Data":"ab7b1607e93719f69ff97243b27d16cc4c05f6769f20d1c2bf6833bf115b4200"} Jul 20 22:51:31.159238 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.158993 2568 scope.go:117] "RemoveContainer" containerID="1ffd41d90f9636491d945ca5f97d84e3edf547a3620d190b80d984f72e896cc3" Jul 20 22:51:31.249125 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.249061 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:31.290659 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290623 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290669 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290703 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5zng\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290777 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290807 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.290851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290833 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.291178 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290874 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.291178 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.290895 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy\") pod \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\" (UID: \"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef\") " Jul 20 22:51:31.291301 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.291221 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:51:31.291425 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.291402 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:51:31.291485 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.291426 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:51:31.291675 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.291654 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:51:31.291782 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.291762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:51:31.293558 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.293518 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:51:31.293760 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.293735 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng" (OuterVolumeSpecName: "kube-api-access-t5zng") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "kube-api-access-t5zng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:51:31.293851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.293762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:51:31.293851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.293795 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" (UID: "d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:51:31.398193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398152 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5zng\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-kube-api-access-t5zng\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398189 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398193 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398203 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398216 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398229 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398241 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398252 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398391 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:31.398453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:31.398400 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:51:32.165859 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.165830 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" Jul 20 22:51:32.166284 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.165852 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc" event={"ID":"d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef","Type":"ContainerDied","Data":"f8d8de8cb901b040a01dc6d9a6ec98d30f293b63351ddee81c781d74c04b1822"} Jul 20 22:51:32.166284 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.165936 2568 scope.go:117] "RemoveContainer" containerID="ab7b1607e93719f69ff97243b27d16cc4c05f6769f20d1c2bf6833bf115b4200" Jul 20 22:51:32.190103 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.190064 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:51:32.193647 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.193625 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-23458506-openshift-default-b458bd949-trprc"] Jul 20 22:51:32.297998 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:32.297962 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" path="/var/lib/kubelet/pods/d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef/volumes" Jul 20 22:51:43.241531 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.241425 2568 generic.go:356] "Generic (PLEG): container finished" podID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerID="69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55" exitCode=0 Jul 20 22:51:43.241929 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.241516 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerDied","Data":"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55"} Jul 20 22:51:43.241929 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.241920 2568 scope.go:117] "RemoveContainer" containerID="69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55" Jul 20 22:51:43.242958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.242931 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:43.243014 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.243000 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:43.243057 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:43.243046 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:51:44.145726 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:44.145684 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:44.248290 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:44.248254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerStarted","Data":"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d"} Jul 20 22:51:44.298784 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:44.298749 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:44.299827 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:44.299806 2568 patch_prober.go:28] interesting pod/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 22:51:44.299893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:44.299853 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 22:51:45.299215 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:45.299176 2568 patch_prober.go:28] interesting pod/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 22:51:45.299648 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:45.299230 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 22:51:46.298729 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:46.298696 2568 patch_prober.go:28] interesting pod/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 22:51:46.298906 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:46.298763 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 22:51:47.298637 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:47.298600 2568 patch_prober.go:28] interesting pod/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 22:51:47.299003 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:47.298663 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 22:51:48.302396 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:48.302364 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:48.302849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:48.302798 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:51:48.303393 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:51:48.303375 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:52:09.840422 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:09.840385 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:52:09.840974 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:09.840630 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" containerID="cri-o://cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d" gracePeriod=30 Jul 20 22:52:10.609066 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609029 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:52:10.609464 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609440 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.609464 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609463 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.609676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609519 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.609676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609530 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.609676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609655 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.609676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.609668 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79b37ba-5c46-4d6c-8e52-9b4e1c2593ef" containerName="istio-proxy" Jul 20 22:52:10.612958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.612938 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.615443 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.615422 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cf9642a2-openshift-default-dockercfg-9z9k5\"" Jul 20 22:52:10.624770 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.624738 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:52:10.768865 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.768832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.768865 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.768869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.768897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.768977 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.769033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qk7c\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769132 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.769122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769304 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.769164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769304 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.769202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.769304 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.769257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870277 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870277 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870247 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870277 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qk7c\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870652 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870737 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870789 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.870900 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.870852 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.871361 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.871341 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.872779 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.872755 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.872941 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.872923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.883355 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.883327 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.883656 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.883634 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qk7c\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c\") pod \"e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:10.924564 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:10.924521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:11.070312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.070287 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:52:11.072270 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:52:11.072235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f7bca0_2478_4af9_b5a6_3ac969b36e35.slice/crio-b4b5f7df0bb51062c39260e2336aec3b3f2d03461d62fd621fb472bfbe273658 WatchSource:0}: Error finding container b4b5f7df0bb51062c39260e2336aec3b3f2d03461d62fd621fb472bfbe273658: Status 404 returned error can't find the container with id b4b5f7df0bb51062c39260e2336aec3b3f2d03461d62fd621fb472bfbe273658 Jul 20 22:52:11.074473 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.074439 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:11.074570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.074529 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:11.074570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.074557 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:11.395164 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.395079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerStarted","Data":"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f"} Jul 20 22:52:11.395164 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.395126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerStarted","Data":"b4b5f7df0bb51062c39260e2336aec3b3f2d03461d62fd621fb472bfbe273658"} Jul 20 22:52:11.427731 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.427673 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podStartSLOduration=1.427656945 podStartE2EDuration="1.427656945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:52:11.424027584 +0000 UTC m=+1785.632860514" watchObservedRunningTime="2026-07-20 22:52:11.427656945 +0000 UTC m=+1785.636489935" Jul 20 22:52:11.925239 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:11.925194 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:12.930409 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:12.930373 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:13.406802 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:13.406769 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:13.407613 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:13.407594 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:15.102126 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.102053 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:52:15.207710 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207673 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207722 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207786 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207817 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207846 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207867 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl2t6\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.207904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207895 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.208219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207963 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.208219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.207992 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert\") pod \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\" (UID: \"fb7b1c1d-6352-462b-b269-cc72c6e28a78\") " Jul 20 22:52:15.208219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208102 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:52:15.208219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208107 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:52:15.208422 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208337 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.208422 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208358 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.208643 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208599 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:52:15.208733 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.208641 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:52:15.209114 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.209087 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:52:15.210265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.210238 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:52:15.210385 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.210286 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:52:15.210385 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.210343 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6" (OuterVolumeSpecName: "kube-api-access-wl2t6") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "kube-api-access-wl2t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:52:15.210385 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.210345 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb7b1c1d-6352-462b-b269-cc72c6e28a78" (UID: "fb7b1c1d-6352-462b-b269-cc72c6e28a78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:52:15.308926 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308889 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.308926 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308920 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.308926 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308931 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl2t6\" (UniqueName: \"kubernetes.io/projected/fb7b1c1d-6352-462b-b269-cc72c6e28a78-kube-api-access-wl2t6\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.309160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308939 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.309160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308948 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.309160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308955 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.309160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.308963 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7b1c1d-6352-462b-b269-cc72c6e28a78-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:52:15.419561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.419457 2568 generic.go:356] "Generic (PLEG): container finished" podID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerID="cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d" exitCode=0 Jul 20 22:52:15.419561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.419514 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" Jul 20 22:52:15.419561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.419534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerDied","Data":"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d"} Jul 20 22:52:15.419801 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.419588 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj" event={"ID":"fb7b1c1d-6352-462b-b269-cc72c6e28a78","Type":"ContainerDied","Data":"0047b8747a01cdfc2300b83b4065bc4f3afd53665be34f98e3834ebaa9ad1f2f"} Jul 20 22:52:15.419801 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.419611 2568 scope.go:117] "RemoveContainer" containerID="cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d" Jul 20 22:52:15.429742 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.429718 2568 scope.go:117] "RemoveContainer" containerID="69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55" Jul 20 22:52:15.441143 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.441028 2568 scope.go:117] "RemoveContainer" containerID="cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d" Jul 20 22:52:15.441629 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:52:15.441606 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d\": container with ID starting with cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d not found: ID does not exist" containerID="cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d" Jul 20 22:52:15.441742 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.441641 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d"} err="failed to get container status \"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d\": rpc error: code = NotFound desc = could not find container \"cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d\": container with ID starting with cbe652e2241d664c31aae978cb7ffa11eb8eb90215781fdaf962eb4a41d0d10d not found: ID does not exist" Jul 20 22:52:15.441742 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.441664 2568 scope.go:117] "RemoveContainer" containerID="69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55" Jul 20 22:52:15.441984 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:52:15.441958 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55\": container with ID starting with 69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55 not found: ID does not exist" containerID="69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55" Jul 20 22:52:15.442069 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.441992 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55"} err="failed to get container status \"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55\": rpc error: code = NotFound desc = could not find container \"69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55\": container with ID starting with 69bce6ff681100cc6d07b09f27553296e721ddd537a4c13124b888912916da55 not found: ID does not exist" Jul 20 22:52:15.445473 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.445446 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:52:15.452955 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:15.452932 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-55938262-gw-openshift-default-7f4bbd8f5f-lltjj"] Jul 20 22:52:16.297554 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:16.297514 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" path="/var/lib/kubelet/pods/fb7b1c1d-6352-462b-b269-cc72c6e28a78/volumes" Jul 20 22:52:26.415219 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:26.415188 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:52:26.422440 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:26.422419 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:52:27.488637 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.488603 2568 generic.go:356] "Generic (PLEG): container finished" podID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerID="3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f" exitCode=0 Jul 20 22:52:27.489109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.488678 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerDied","Data":"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f"} Jul 20 22:52:27.489109 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.489080 2568 scope.go:117] "RemoveContainer" containerID="3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f" Jul 20 22:52:27.490139 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.490109 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:27.490212 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.490195 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:27.490254 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:27.490243 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:28.407478 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:28.407435 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:28.495343 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:28.495307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerStarted","Data":"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e"} Jul 20 22:52:28.926676 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:28.926636 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:28.926894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:28.926791 2568 patch_prober.go:28] interesting pod/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 22:52:28.926894 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:28.926838 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 22:52:29.925305 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:29.925268 2568 patch_prober.go:28] interesting pod/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 22:52:29.925937 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:29.925903 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 22:52:30.925705 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:30.925659 2568 patch_prober.go:28] interesting pod/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 22:52:30.926218 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:30.925728 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 22:52:31.925309 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:31.925263 2568 patch_prober.go:28] interesting pod/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 22:52:31.925537 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:31.925333 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 22:52:32.929328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:32.929293 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:32.929724 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:32.929585 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:32.930151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:32.930131 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:52:54.819038 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:54.818997 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:52:54.819583 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:54.819207 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" containerID="cri-o://3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e" gracePeriod=30 Jul 20 22:52:55.592265 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592223 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:52:55.592674 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592659 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:52:55.592674 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592675 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:52:55.592794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592690 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:52:55.592794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592695 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:52:55.592794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.592750 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:52:55.596026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.595999 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.598641 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.598619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0332ce3d-openshift-default-dockercfg-vgtkv\"" Jul 20 22:52:55.614954 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.614927 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:52:55.687995 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.687958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688194 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688194 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltm78\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688194 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688194 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688357 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688357 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688357 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.688467 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.688379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.788868 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.788830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.788876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.788908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.788960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789039 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltm78\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789492 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789325 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789492 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789361 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789770 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789841 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789819 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.789904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.789888 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.792039 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.792017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.792186 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.792171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.797941 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.797914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.798654 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.798627 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltm78\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78\") pod \"e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:55.906933 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:55.906847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:56.076011 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.075987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:52:56.077945 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:52:56.077920 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cd9ce5_f55c_409d_9c27_aebb9064d143.slice/crio-f3c2ddace83ca261b144b5db18f56ee9745d42cd6d3517512392c39375093d92 WatchSource:0}: Error finding container f3c2ddace83ca261b144b5db18f56ee9745d42cd6d3517512392c39375093d92: Status 404 returned error can't find the container with id f3c2ddace83ca261b144b5db18f56ee9745d42cd6d3517512392c39375093d92 Jul 20 22:52:56.080083 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.080042 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:56.080163 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.080136 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:56.080202 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.080186 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:52:56.673148 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.673107 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerStarted","Data":"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43"} Jul 20 22:52:56.673329 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.673161 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerStarted","Data":"f3c2ddace83ca261b144b5db18f56ee9745d42cd6d3517512392c39375093d92"} Jul 20 22:52:56.694062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.694013 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podStartSLOduration=1.693998348 podStartE2EDuration="1.693998348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:52:56.692590983 +0000 UTC m=+1830.901423915" watchObservedRunningTime="2026-07-20 22:52:56.693998348 +0000 UTC m=+1830.902831319" Jul 20 22:52:56.907586 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:56.907556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:57.913014 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:57.912984 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:58.685176 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:58.685145 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:52:58.686296 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:52:58.686275 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:00.069212 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.069187 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:53:00.132857 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132776 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.132857 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132837 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132864 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132902 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qk7c\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132921 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132947 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.132979 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133028 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133086 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133055 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs\") pod \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\" (UID: \"d2f7bca0-2478-4af9-b5a6-3ac969b36e35\") " Jul 20 22:53:00.133458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133181 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:00.133458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133245 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:00.133458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133394 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:00.133458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133412 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:53:00.133714 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133462 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.133714 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.133484 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.134034 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.134005 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:00.135106 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.135071 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:53:00.135312 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.135288 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:53:00.135373 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.135335 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:00.135373 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.135337 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c" (OuterVolumeSpecName: "kube-api-access-9qk7c") pod "d2f7bca0-2478-4af9-b5a6-3ac969b36e35" (UID: "d2f7bca0-2478-4af9-b5a6-3ac969b36e35"). InnerVolumeSpecName "kube-api-access-9qk7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:53:00.234908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234870 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.234908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234903 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qk7c\" (UniqueName: \"kubernetes.io/projected/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-kube-api-access-9qk7c\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.234908 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234915 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.235139 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234924 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.235139 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234932 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.235139 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234939 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.235139 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.234947 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2f7bca0-2478-4af9-b5a6-3ac969b36e35-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:00.698110 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.698072 2568 generic.go:356] "Generic (PLEG): container finished" podID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerID="3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e" exitCode=0 Jul 20 22:53:00.698308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.698123 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" Jul 20 22:53:00.698308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.698165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerDied","Data":"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e"} Jul 20 22:53:00.698308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.698231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs" event={"ID":"d2f7bca0-2478-4af9-b5a6-3ac969b36e35","Type":"ContainerDied","Data":"b4b5f7df0bb51062c39260e2336aec3b3f2d03461d62fd621fb472bfbe273658"} Jul 20 22:53:00.698308 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.698257 2568 scope.go:117] "RemoveContainer" containerID="3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e" Jul 20 22:53:00.710794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.710775 2568 scope.go:117] "RemoveContainer" containerID="3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f" Jul 20 22:53:00.716225 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.716193 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:53:00.719838 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.719818 2568 scope.go:117] "RemoveContainer" containerID="3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e" Jul 20 22:53:00.720217 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:53:00.720188 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e\": container with ID starting with 3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e not found: ID does not exist" containerID="3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e" Jul 20 22:53:00.720310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.720228 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e"} err="failed to get container status \"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e\": rpc error: code = NotFound desc = could not find container \"3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e\": container with ID starting with 3dc1d718bd202b041ebe302452c46f688b37f31bb323b9cd8fd8fc17bba9b11e not found: ID does not exist" Jul 20 22:53:00.720310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.720251 2568 scope.go:117] "RemoveContainer" containerID="3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f" Jul 20 22:53:00.720546 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:53:00.720519 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f\": container with ID starting with 3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f not found: ID does not exist" containerID="3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f" Jul 20 22:53:00.720594 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.720552 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f"} err="failed to get container status \"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f\": rpc error: code = NotFound desc = could not find container \"3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f\": container with ID starting with 3aae2229b08c0b4e1a4f076ff0f23d157ee1a01af513de9e90d0cf4bd43c657f not found: ID does not exist" Jul 20 22:53:00.722248 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:00.722228 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cf9642a2-openshift-default-6c588d4b7c-6jkgs"] Jul 20 22:53:02.297396 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:02.297360 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" path="/var/lib/kubelet/pods/d2f7bca0-2478-4af9-b5a6-3ac969b36e35/volumes" Jul 20 22:53:09.763709 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.763668 2568 generic.go:356] "Generic (PLEG): container finished" podID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerID="9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43" exitCode=0 Jul 20 22:53:09.764144 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.763742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerDied","Data":"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43"} Jul 20 22:53:09.764144 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.764112 2568 scope.go:117] "RemoveContainer" containerID="9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43" Jul 20 22:53:09.769082 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.765454 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:53:09.769082 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.765685 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:53:09.769082 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:09.765808 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:53:10.771899 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:10.771867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerStarted","Data":"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6"} Jul 20 22:53:10.907038 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:10.907002 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:10.908422 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:10.908387 2568 patch_prober.go:28] interesting pod/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 22:53:10.908608 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:10.908467 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 22:53:11.908317 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:11.908275 2568 patch_prober.go:28] interesting pod/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 22:53:11.909036 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:11.909000 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 22:53:12.907976 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:12.907937 2568 patch_prober.go:28] interesting pod/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 22:53:12.908298 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:12.908266 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 22:53:13.686042 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:13.686008 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:13.907835 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:13.907784 2568 patch_prober.go:28] interesting pod/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 22:53:13.908043 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:13.907858 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 22:53:14.911615 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:14.911585 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:14.912620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:14.912588 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:38.154323 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:38.154286 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:53:38.154756 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:38.154518 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" containerID="cri-o://7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6" gracePeriod=30 Jul 20 22:53:43.418597 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.418527 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:43.540331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540291 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltm78\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540331 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540335 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540356 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540380 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540548 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540646 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540615 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540652 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540686 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540753 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy\") pod \"93cd9ce5-f55c-409d-9c27-aebb9064d143\" (UID: \"93cd9ce5-f55c-409d-9c27-aebb9064d143\") " Jul 20 22:53:43.540875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540781 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:43.540875 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540815 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:43.541142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540898 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:43.541142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.540988 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:53:43.541142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.541107 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.541142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.541128 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.541142 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.541144 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.541360 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.541158 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd9ce5-f55c-409d-9c27-aebb9064d143-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.541401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.541360 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data" (OuterVolumeSpecName: "istio-data") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:43.542657 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.542634 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token" (OuterVolumeSpecName: "istio-token") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:53:43.542956 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.542936 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:53:43.543171 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.543157 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:53:43.543227 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.543181 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78" (OuterVolumeSpecName: "kube-api-access-ltm78") pod "93cd9ce5-f55c-409d-9c27-aebb9064d143" (UID: "93cd9ce5-f55c-409d-9c27-aebb9064d143"). InnerVolumeSpecName "kube-api-access-ltm78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:53:43.642037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.641996 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.642037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.642031 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltm78\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-kube-api-access-ltm78\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.642037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.642041 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.642037 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.642051 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.642315 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.642059 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd9ce5-f55c-409d-9c27-aebb9064d143-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:53:43.951191 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.951158 2568 generic.go:356] "Generic (PLEG): container finished" podID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerID="7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6" exitCode=0 Jul 20 22:53:43.951399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.951201 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" Jul 20 22:53:43.951399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.951239 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerDied","Data":"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6"} Jul 20 22:53:43.951399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.951301 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d" event={"ID":"93cd9ce5-f55c-409d-9c27-aebb9064d143","Type":"ContainerDied","Data":"f3c2ddace83ca261b144b5db18f56ee9745d42cd6d3517512392c39375093d92"} Jul 20 22:53:43.951399 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.951331 2568 scope.go:117] "RemoveContainer" containerID="7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6" Jul 20 22:53:43.961570 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.961550 2568 scope.go:117] "RemoveContainer" containerID="9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43" Jul 20 22:53:43.969870 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.969844 2568 scope.go:117] "RemoveContainer" containerID="7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6" Jul 20 22:53:43.970134 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:53:43.970115 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6\": container with ID starting with 7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6 not found: ID does not exist" containerID="7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6" Jul 20 22:53:43.970183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.970144 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6"} err="failed to get container status \"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6\": rpc error: code = NotFound desc = could not find container \"7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6\": container with ID starting with 7ca0300be0f75c896a19ad52799ada2cd6f0270f06896a86a437ff90c0384ee6 not found: ID does not exist" Jul 20 22:53:43.970183 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.970162 2568 scope.go:117] "RemoveContainer" containerID="9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43" Jul 20 22:53:43.970407 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:53:43.970390 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43\": container with ID starting with 9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43 not found: ID does not exist" containerID="9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43" Jul 20 22:53:43.970458 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.970411 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43"} err="failed to get container status \"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43\": rpc error: code = NotFound desc = could not find container \"9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43\": container with ID starting with 9c8ef8c53c1d2528a6f2c1d27ffc25328a0876ae165b9bb391a81ae8c81d7f43 not found: ID does not exist" Jul 20 22:53:43.976151 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.976126 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:53:43.979851 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:43.979824 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0332ce3d-openshift-default-5dd44c7c47-ncs7d"] Jul 20 22:53:44.296459 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:53:44.296428 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" path="/var/lib/kubelet/pods/93cd9ce5-f55c-409d-9c27-aebb9064d143/volumes" Jul 20 22:55:23.542003 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.541920 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542378 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542393 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542402 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542408 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542417 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542423 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542436 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542441 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542520 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7b1c1d-6352-462b-b269-cc72c6e28a78" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542533 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542540 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.542539 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542547 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f7bca0-2478-4af9-b5a6-3ac969b36e35" containerName="istio-proxy" Jul 20 22:55:23.542976 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.542554 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cd9ce5-f55c-409d-9c27-aebb9064d143" containerName="istio-proxy" Jul 20 22:55:23.545757 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.545741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.549582 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.549556 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-36f27dea-openshift-default-dockercfg-b854s\"" Jul 20 22:55:23.551461 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551614 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551614 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551614 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551614 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551601 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7fk\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551849 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.551957 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.551876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.583618 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.583584 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:55:23.652745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652745 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7fk\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.652988 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.652953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653009 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653200 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653352 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653229 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653545 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653447 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653545 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653471 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.653769 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.653745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.655667 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.655645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.655806 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.655791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.679315 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.679282 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.679315 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.679301 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7fk\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk\") pod \"e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:23.856506 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:23.856458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:24.000413 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.000222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:55:24.002731 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:55:24.002699 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb1dbc3_37db_4893_b74f_84831a605c5c.slice/crio-f4d8adfc5b9027a6e8f189611da2dc53d8db0eff2bf9e1e327360622b977b6ee WatchSource:0}: Error finding container f4d8adfc5b9027a6e8f189611da2dc53d8db0eff2bf9e1e327360622b977b6ee: Status 404 returned error can't find the container with id f4d8adfc5b9027a6e8f189611da2dc53d8db0eff2bf9e1e327360622b977b6ee Jul 20 22:55:24.004832 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.004797 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:24.004943 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.004870 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:24.004943 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.004897 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:24.492177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.492127 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerStarted","Data":"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37"} Jul 20 22:55:24.492383 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.492191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerStarted","Data":"f4d8adfc5b9027a6e8f189611da2dc53d8db0eff2bf9e1e327360622b977b6ee"} Jul 20 22:55:24.516252 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.516201 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podStartSLOduration=1.516184945 podStartE2EDuration="1.516184945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:55:24.514072338 +0000 UTC m=+1978.722905278" watchObservedRunningTime="2026-07-20 22:55:24.516184945 +0000 UTC m=+1978.725017873" Jul 20 22:55:24.857278 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:24.857251 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:25.861973 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:25.861942 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:26.503020 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:26.502984 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:26.504115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:26.504091 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:41.504902 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.504867 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 22:55:41.505333 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.504927 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 22:55:41.590858 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.590822 2568 generic.go:356] "Generic (PLEG): container finished" podID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerID="40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37" exitCode=0 Jul 20 22:55:41.591026 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.590893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerDied","Data":"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37"} Jul 20 22:55:41.591316 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.591302 2568 scope.go:117] "RemoveContainer" containerID="40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37" Jul 20 22:55:41.592345 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.592316 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:41.592403 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.592391 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:41.592445 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:41.592423 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:55:42.597606 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:42.597572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerStarted","Data":"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c"} Jul 20 22:55:42.856980 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:42.856893 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:42.857154 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:42.857125 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 22:55:42.857227 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:42.857180 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 22:55:43.857168 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:43.857131 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 22:55:43.857595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:43.857194 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 22:55:44.857803 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:44.857765 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 22:55:44.858226 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:44.857823 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 22:55:45.856910 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:45.856872 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 22:55:45.857094 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:45.856963 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 22:55:46.861367 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:46.861334 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:46.861789 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:46.861609 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:55:46.862376 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:55:46.862358 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:56:00.077738 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:00.077695 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:56:00.078257 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:00.077953 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" containerID="cri-o://2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c" gracePeriod=30 Jul 20 22:56:01.864764 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:01.864717 2568 patch_prober.go:28] interesting pod/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 22:56:01.865146 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:01.864786 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 22:56:05.336847 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.336818 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:56:05.453084 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453002 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453084 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453041 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453084 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453070 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453251 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453295 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453363 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453324 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453389 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw7fk\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453321 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:56:05.453579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453436 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453579 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453574 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket\") pod \"adb1dbc3-37db-4893-b74f-84831a605c5c\" (UID: \"adb1dbc3-37db-4893-b74f-84831a605c5c\") " Jul 20 22:56:05.453794 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453633 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.453895 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.454073 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.454092 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.454111 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adb1dbc3-37db-4893-b74f-84831a605c5c-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.454125 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.454349 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.454208 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:56:05.455459 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.455431 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:56:05.455594 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.455567 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:56:05.455594 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.455573 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:56:05.455829 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.455811 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk" (OuterVolumeSpecName: "kube-api-access-bw7fk") pod "adb1dbc3-37db-4893-b74f-84831a605c5c" (UID: "adb1dbc3-37db-4893-b74f-84831a605c5c"). InnerVolumeSpecName "kube-api-access-bw7fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:56:05.554698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554644 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.554698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554691 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.554698 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554706 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.554958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554719 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.554958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554732 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw7fk\" (UniqueName: \"kubernetes.io/projected/adb1dbc3-37db-4893-b74f-84831a605c5c-kube-api-access-bw7fk\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.554958 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.554743 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adb1dbc3-37db-4893-b74f-84831a605c5c-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:56:05.728028 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.727933 2568 generic.go:356] "Generic (PLEG): container finished" podID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerID="2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c" exitCode=0 Jul 20 22:56:05.728028 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.727977 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerDied","Data":"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c"} Jul 20 22:56:05.728268 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.728029 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" event={"ID":"adb1dbc3-37db-4893-b74f-84831a605c5c","Type":"ContainerDied","Data":"f4d8adfc5b9027a6e8f189611da2dc53d8db0eff2bf9e1e327360622b977b6ee"} Jul 20 22:56:05.728268 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.727983 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch" Jul 20 22:56:05.728268 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.728059 2568 scope.go:117] "RemoveContainer" containerID="2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c" Jul 20 22:56:05.741300 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.741278 2568 scope.go:117] "RemoveContainer" containerID="40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37" Jul 20 22:56:05.751888 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.751862 2568 scope.go:117] "RemoveContainer" containerID="2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c" Jul 20 22:56:05.752228 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:56:05.752198 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c\": container with ID starting with 2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c not found: ID does not exist" containerID="2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c" Jul 20 22:56:05.752328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.752241 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c"} err="failed to get container status \"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c\": rpc error: code = NotFound desc = could not find container \"2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c\": container with ID starting with 2fe6f3b90f970b4e94688c03f92891f79e5b8b5507fe725a97e13103066fd67c not found: ID does not exist" Jul 20 22:56:05.752328 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.752268 2568 scope.go:117] "RemoveContainer" containerID="40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37" Jul 20 22:56:05.752662 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:56:05.752643 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37\": container with ID starting with 40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37 not found: ID does not exist" containerID="40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37" Jul 20 22:56:05.752728 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.752672 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37"} err="failed to get container status \"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37\": rpc error: code = NotFound desc = could not find container \"40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37\": container with ID starting with 40c8454951cf0dbbad5b4654fcfb95d9dda8718ee2ef64fe5615560f96f9bf37 not found: ID does not exist" Jul 20 22:56:05.753586 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.753566 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:56:05.760144 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:05.760120 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-36f27dea-openshift-default-9b58cff55-rdxch"] Jul 20 22:56:06.299478 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:06.299434 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" path="/var/lib/kubelet/pods/adb1dbc3-37db-4893-b74f-84831a605c5c/volumes" Jul 20 22:56:19.721911 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.721878 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:56:19.722434 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722413 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.722547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722437 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.722547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722454 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.722547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722462 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.722711 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722581 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.722711 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.722594 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb1dbc3-37db-4893-b74f-84831a605c5c" containerName="istio-proxy" Jul 20 22:56:19.727420 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.727398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.729661 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.729639 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5418bc43-openshift-default-dockercfg-lnr8k\"" Jul 20 22:56:19.737711 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.737685 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:56:19.782820 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.782820 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mk2\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.782992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.783037 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.783062 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.783061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884551 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mk2\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884728 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.884775 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.884798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.885030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.885029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885160 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.885137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885309 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.885242 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.885431 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.885409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.887370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.887345 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.887370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.887363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.896116 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.896088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:19.896261 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:19.896210 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mk2\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2\") pod \"e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:20.039707 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.039611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:20.204083 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.204053 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:56:20.205289 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:56:20.205260 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebf1219_9144_43dd_9073_301f113ab1b7.slice/crio-fdac188e7b3d2af7643aa8ccc7a87662f02edac4995235a5e68702b1eb351162 WatchSource:0}: Error finding container fdac188e7b3d2af7643aa8ccc7a87662f02edac4995235a5e68702b1eb351162: Status 404 returned error can't find the container with id fdac188e7b3d2af7643aa8ccc7a87662f02edac4995235a5e68702b1eb351162 Jul 20 22:56:20.207453 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.207415 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:20.207569 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.207486 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:20.207569 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.207554 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:20.812088 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.812051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerStarted","Data":"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20"} Jul 20 22:56:20.812535 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.812112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerStarted","Data":"fdac188e7b3d2af7643aa8ccc7a87662f02edac4995235a5e68702b1eb351162"} Jul 20 22:56:20.832129 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:20.832073 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podStartSLOduration=1.832058527 podStartE2EDuration="1.832058527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:56:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:56:20.830689398 +0000 UTC m=+2035.039522338" watchObservedRunningTime="2026-07-20 22:56:20.832058527 +0000 UTC m=+2035.040891457" Jul 20 22:56:21.040271 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:21.040230 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:21.045234 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:21.045203 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:21.818215 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:21.818183 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:21.819242 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:21.819223 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:34.904722 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.904684 2568 generic.go:356] "Generic (PLEG): container finished" podID="cebf1219-9144-43dd-9073-301f113ab1b7" containerID="0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20" exitCode=0 Jul 20 22:56:34.905249 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.904727 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerDied","Data":"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20"} Jul 20 22:56:34.905249 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.905244 2568 scope.go:117] "RemoveContainer" containerID="0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20" Jul 20 22:56:34.906354 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.906322 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:34.906460 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.906393 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:34.906460 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:34.906425 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:56:35.915690 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:35.915644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerStarted","Data":"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b"} Jul 20 22:56:36.040807 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:36.040765 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:36.042034 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:36.042008 2568 patch_prober.go:28] interesting pod/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 22:56:36.042147 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:36.042069 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 22:56:36.818665 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:36.818615 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:37.040547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:37.040480 2568 patch_prober.go:28] interesting pod/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 22:56:37.040947 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:37.040570 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 22:56:38.040869 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:38.040816 2568 patch_prober.go:28] interesting pod/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 22:56:38.041298 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:38.040878 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 22:56:39.040835 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:39.040800 2568 patch_prober.go:28] interesting pod/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 22:56:39.041021 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:39.040874 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 22:56:40.043895 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:40.043866 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:56:40.045059 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:56:40.045033 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:57:26.452133 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:57:26.452105 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:57:26.463472 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:57:26.463442 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 22:58:11.487827 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:11.487789 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:58:11.488443 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:11.488028 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" containerID="cri-o://89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b" gracePeriod=30 Jul 20 22:58:16.748979 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.748904 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:58:16.885100 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885056 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885142 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885223 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885250 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885335 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885382 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885401 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885384 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:58:16.885796 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885421 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mk2\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885796 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885449 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket\") pod \"cebf1219-9144-43dd-9073-301f113ab1b7\" (UID: \"cebf1219-9144-43dd-9073-301f113ab1b7\") " Jul 20 22:58:16.885796 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885600 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:58:16.885796 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885789 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.886003 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885808 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.886003 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885825 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:58:16.886003 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.885851 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 22:58:16.886307 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.886280 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:58:16.887547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.887490 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 22:58:16.887547 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.887524 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 22:58:16.887732 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.887668 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2" (OuterVolumeSpecName: "kube-api-access-g4mk2") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "kube-api-access-g4mk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:58:16.887732 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.887688 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "cebf1219-9144-43dd-9073-301f113ab1b7" (UID: "cebf1219-9144-43dd-9073-301f113ab1b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 22:58:16.986840 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986800 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.986840 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986833 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.986840 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986841 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.986840 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986849 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cebf1219-9144-43dd-9073-301f113ab1b7-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.987130 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986858 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mk2\" (UniqueName: \"kubernetes.io/projected/cebf1219-9144-43dd-9073-301f113ab1b7-kube-api-access-g4mk2\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.987130 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986867 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cebf1219-9144-43dd-9073-301f113ab1b7-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:16.987130 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:16.986877 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cebf1219-9144-43dd-9073-301f113ab1b7-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 22:58:17.479780 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.479743 2568 generic.go:356] "Generic (PLEG): container finished" podID="cebf1219-9144-43dd-9073-301f113ab1b7" containerID="89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b" exitCode=0 Jul 20 22:58:17.479996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.479793 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerDied","Data":"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b"} Jul 20 22:58:17.479996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.479809 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" Jul 20 22:58:17.479996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.479834 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h" event={"ID":"cebf1219-9144-43dd-9073-301f113ab1b7","Type":"ContainerDied","Data":"fdac188e7b3d2af7643aa8ccc7a87662f02edac4995235a5e68702b1eb351162"} Jul 20 22:58:17.479996 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.479854 2568 scope.go:117] "RemoveContainer" containerID="89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b" Jul 20 22:58:17.489550 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.489527 2568 scope.go:117] "RemoveContainer" containerID="0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20" Jul 20 22:58:17.498260 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.498235 2568 scope.go:117] "RemoveContainer" containerID="89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b" Jul 20 22:58:17.498640 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:58:17.498613 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b\": container with ID starting with 89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b not found: ID does not exist" containerID="89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b" Jul 20 22:58:17.498737 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.498649 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b"} err="failed to get container status \"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b\": rpc error: code = NotFound desc = could not find container \"89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b\": container with ID starting with 89c422a84764cc3b998f289908ee5eca84ef909dc233c9a1cc0326f45f3c0b1b not found: ID does not exist" Jul 20 22:58:17.498737 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.498666 2568 scope.go:117] "RemoveContainer" containerID="0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20" Jul 20 22:58:17.498933 ip-10-0-135-161 kubenswrapper[2568]: E0720 22:58:17.498908 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20\": container with ID starting with 0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20 not found: ID does not exist" containerID="0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20" Jul 20 22:58:17.498995 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.498940 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20"} err="failed to get container status \"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20\": rpc error: code = NotFound desc = could not find container \"0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20\": container with ID starting with 0693ed9952b10e4561793e450da7d773e40af5010d452d9e09faf0711a09ec20 not found: ID does not exist" Jul 20 22:58:17.501740 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.501715 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:58:17.505630 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:17.505602 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5418bc43-openshift-default-595bc4676c-fzc5h"] Jul 20 22:58:18.297660 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:58:18.297624 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" path="/var/lib/kubelet/pods/cebf1219-9144-43dd-9073-301f113ab1b7/volumes" Jul 20 22:59:07.381178 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381145 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 22:59:07.381686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381542 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:07.381686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381557 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:07.381686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381568 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:07.381686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381574 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:07.381686 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.381630 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:07.384373 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.384358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.386715 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.386689 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-222578-openshift-default-dockercfg-xf6h5\"" Jul 20 22:59:07.395529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.395483 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 22:59:07.546235 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltj4p\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546235 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546242 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546536 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546536 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546536 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.546683 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.546640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.647866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.647777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.647866 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.647815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.647876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltj4p\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.647915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.647983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648065 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648001 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648266 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648209 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648403 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648403 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648309 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648403 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648341 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648629 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648488 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648695 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648654 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.648916 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.648898 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.650335 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.650317 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.650617 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.650596 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.656357 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.656320 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.656529 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.656335 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltj4p\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p\") pod \"e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.696657 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.696620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:07.841061 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.841034 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 22:59:07.843079 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:59:07.843050 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea18cff1_ba1f_479d_8872_2e9f51f2494f.slice/crio-664bc8fbda3a1cf15fa0b86bd0792c2710776bef45c1396d6d41f5832aaec704 WatchSource:0}: Error finding container 664bc8fbda3a1cf15fa0b86bd0792c2710776bef45c1396d6d41f5832aaec704: Status 404 returned error can't find the container with id 664bc8fbda3a1cf15fa0b86bd0792c2710776bef45c1396d6d41f5832aaec704 Jul 20 22:59:07.845115 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.845079 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:07.845206 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.845145 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:07.845206 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:07.845173 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:08.765513 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:08.765457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerStarted","Data":"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f"} Jul 20 22:59:08.765924 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:08.765548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerStarted","Data":"664bc8fbda3a1cf15fa0b86bd0792c2710776bef45c1396d6d41f5832aaec704"} Jul 20 22:59:08.789083 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:08.789020 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podStartSLOduration=1.789003579 podStartE2EDuration="1.789003579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:59:08.786348565 +0000 UTC m=+2202.995181514" watchObservedRunningTime="2026-07-20 22:59:08.789003579 +0000 UTC m=+2202.997836508" Jul 20 22:59:09.697674 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:09.697637 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:09.702652 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:09.702623 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:09.771595 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:09.771552 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:09.772636 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:09.772616 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:15.770551 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.770516 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 22:59:15.771220 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.771195 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cebf1219-9144-43dd-9073-301f113ab1b7" containerName="istio-proxy" Jul 20 22:59:15.774635 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.774614 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.776904 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.776881 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-35607f-openshift-default-dockercfg-5dkj8\"" Jul 20 22:59:15.785525 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.785470 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 22:59:15.817177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817177 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817433 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqc6r\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.817620 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.817479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918601 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqc6r\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918687 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.918799 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919081 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.918918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919247 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.919217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919303 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.919286 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919371 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.919354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919684 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.919660 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.919747 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.919670 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.921743 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.921723 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.921991 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.921967 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.927542 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.927518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:15.927914 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:15.927894 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqc6r\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r\") pod \"e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:16.086297 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.086263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:16.227294 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.227267 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 22:59:16.228260 ip-10-0-135-161 kubenswrapper[2568]: W0720 22:59:16.228236 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6d154d_31d4_4741_92ad_624eedcafb8f.slice/crio-5c73b2cf218e7d59c9ca9eff6adc3d6960c10410ae27784bed1925e7980b5305 WatchSource:0}: Error finding container 5c73b2cf218e7d59c9ca9eff6adc3d6960c10410ae27784bed1925e7980b5305: Status 404 returned error can't find the container with id 5c73b2cf218e7d59c9ca9eff6adc3d6960c10410ae27784bed1925e7980b5305 Jul 20 22:59:16.230370 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.230334 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:16.230451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.230402 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:16.230451 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.230429 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:16.813175 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.813136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerStarted","Data":"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf"} Jul 20 22:59:16.813608 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.813195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerStarted","Data":"5c73b2cf218e7d59c9ca9eff6adc3d6960c10410ae27784bed1925e7980b5305"} Jul 20 22:59:16.835185 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:16.835131 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podStartSLOduration=1.835115832 podStartE2EDuration="1.835115832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:59:16.832936689 +0000 UTC m=+2211.041769618" watchObservedRunningTime="2026-07-20 22:59:16.835115832 +0000 UTC m=+2211.043948761" Jul 20 22:59:17.086719 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:17.086628 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:17.092311 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:17.092286 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:17.824918 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:17.824884 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:17.829049 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:17.829018 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:24.773155 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.773115 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 22:59:24.773667 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.773182 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 22:59:24.867578 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.867545 2568 generic.go:356] "Generic (PLEG): container finished" podID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerID="429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f" exitCode=0 Jul 20 22:59:24.867790 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.867632 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerDied","Data":"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f"} Jul 20 22:59:24.868158 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.868139 2568 scope.go:117] "RemoveContainer" containerID="429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f" Jul 20 22:59:24.869233 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.869204 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:24.869325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.869269 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:24.869325 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:24.869303 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:25.875342 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:25.875301 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerStarted","Data":"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59"} Jul 20 22:59:26.697882 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:26.697844 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:26.698073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:26.697949 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 22:59:26.698073 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:26.697984 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 22:59:27.697314 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:27.697271 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 22:59:27.697880 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:27.697337 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 22:59:28.697621 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:28.697567 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 22:59:28.698054 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:28.697640 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 22:59:29.697110 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:29.697077 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 22:59:29.697261 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:29.697132 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 22:59:30.701274 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:30.701237 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:30.701712 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:30.701534 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:30.702310 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:30.702290 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 22:59:32.826059 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.826016 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:32.826561 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.826082 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:32.917315 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.917278 2568 generic.go:356] "Generic (PLEG): container finished" podID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerID="534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf" exitCode=0 Jul 20 22:59:32.917484 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.917360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerDied","Data":"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf"} Jul 20 22:59:32.917844 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.917827 2568 scope.go:117] "RemoveContainer" containerID="534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf" Jul 20 22:59:32.918905 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.918876 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:32.918963 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.918945 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:32.919000 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:32.918977 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 22:59:33.929444 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:33.929395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerStarted","Data":"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726"} Jul 20 22:59:34.086893 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:34.086859 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:34.087069 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:34.086987 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:34.087069 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:34.087037 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:35.086828 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:35.086792 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:35.087220 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:35.086848 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:36.087659 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:36.087620 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:36.088053 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:36.087693 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:37.087383 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:37.087343 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:37.087627 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:37.087411 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:38.087123 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:38.087085 2568 patch_prober.go:28] interesting pod/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 22:59:38.087634 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:38.087180 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 22:59:39.090669 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:39.090635 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:39.091257 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:39.091018 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 22:59:39.091778 ip-10-0-135-161 kubenswrapper[2568]: I0720 22:59:39.091762 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 23:01:10.802413 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:10.802373 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 23:01:10.803029 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:10.802598 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" containerID="cri-o://10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59" gracePeriod=30 Jul 20 23:01:15.704425 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:15.704384 2568 patch_prober.go:28] interesting pod/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 23:01:15.704840 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:15.704448 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 23:01:16.059458 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.059428 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 23:01:16.160937 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.160885 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.160937 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.160936 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.160937 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.160956 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.160975 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161022 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161054 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161115 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161165 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltj4p\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161283 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket\") pod \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\" (UID: \"ea18cff1-ba1f-479d-8872-2e9f51f2494f\") " Jul 20 23:01:16.161624 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161277 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:16.161624 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161413 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:01:16.161624 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161307 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:16.161624 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161589 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:16.161842 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161697 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.161842 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161715 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.161842 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161730 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.161842 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.161744 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.162373 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.162344 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:16.163230 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.163206 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:16.163316 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.163224 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:01:16.163316 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.163292 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:01:16.163470 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.163448 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p" (OuterVolumeSpecName: "kube-api-access-ltj4p") pod "ea18cff1-ba1f-479d-8872-2e9f51f2494f" (UID: "ea18cff1-ba1f-479d-8872-2e9f51f2494f"). InnerVolumeSpecName "kube-api-access-ltj4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:01:16.262284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.262179 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.262284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.262225 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltj4p\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-kube-api-access-ltj4p\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.262284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.262236 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.262284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.262244 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.262284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.262252 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18cff1-ba1f-479d-8872-2e9f51f2494f-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:16.496918 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.496879 2568 generic.go:356] "Generic (PLEG): container finished" podID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerID="10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59" exitCode=0 Jul 20 23:01:16.497124 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.496931 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" Jul 20 23:01:16.497124 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.496966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerDied","Data":"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59"} Jul 20 23:01:16.497124 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.497026 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd" event={"ID":"ea18cff1-ba1f-479d-8872-2e9f51f2494f","Type":"ContainerDied","Data":"664bc8fbda3a1cf15fa0b86bd0792c2710776bef45c1396d6d41f5832aaec704"} Jul 20 23:01:16.497124 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.497049 2568 scope.go:117] "RemoveContainer" containerID="10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59" Jul 20 23:01:16.506701 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.506681 2568 scope.go:117] "RemoveContainer" containerID="429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f" Jul 20 23:01:16.516908 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.516839 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 23:01:16.517591 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.517575 2568 scope.go:117] "RemoveContainer" containerID="10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59" Jul 20 23:01:16.517872 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:01:16.517851 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59\": container with ID starting with 10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59 not found: ID does not exist" containerID="10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59" Jul 20 23:01:16.517971 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.517886 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59"} err="failed to get container status \"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59\": rpc error: code = NotFound desc = could not find container \"10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59\": container with ID starting with 10f9cf84c8a00bc8db71bcddf1ce04618fa9b7f44879a5f78358fbfbbc04eb59 not found: ID does not exist" Jul 20 23:01:16.517971 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.517913 2568 scope.go:117] "RemoveContainer" containerID="429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f" Jul 20 23:01:16.518201 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:01:16.518185 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f\": container with ID starting with 429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f not found: ID does not exist" containerID="429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f" Jul 20 23:01:16.518255 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.518209 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f"} err="failed to get container status \"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f\": rpc error: code = NotFound desc = could not find container \"429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f\": container with ID starting with 429ef22cd0e59fc4ecadb110065eab6e887c78e12a5c384b9caba1f406fa5c5f not found: ID does not exist" Jul 20 23:01:16.519240 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:16.519221 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-222578-openshift-default-786ff8b785-4lrvd"] Jul 20 23:01:18.297002 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:18.296967 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" path="/var/lib/kubelet/pods/ea18cff1-ba1f-479d-8872-2e9f51f2494f/volumes" Jul 20 23:01:32.719904 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:32.719869 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 23:01:32.720412 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:32.720132 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" containerID="cri-o://3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726" gracePeriod=30 Jul 20 23:01:33.589261 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.589210 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:01:33.590178 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.590149 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:33.590178 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.590180 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:33.590382 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.590369 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:33.590451 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.590394 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:33.601138 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.601107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.602763 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.602731 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:01:33.604053 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.604028 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-238953-openshift-default-dockercfg-z7qbc\"" Jul 20 23:01:33.724612 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmcnt\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.725007 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.724945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825473 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmcnt\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825473 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825751 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825751 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825751 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825972 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825972 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825972 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825905 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825972 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.825972 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.825953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.826405 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.826257 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.826405 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.826307 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.826405 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.826336 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.826405 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.826343 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.828469 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.828449 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.828820 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.828796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.833531 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.833491 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.834721 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.834689 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmcnt\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt\") pod \"e2e-api-a-238953-openshift-default-5b97f85487-mmdxs\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:33.912667 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:33.912627 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:34.056604 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.056565 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:01:34.057679 ip-10-0-135-161 kubenswrapper[2568]: W0720 23:01:34.057646 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d2f579_0ba0_48fd_bbac_669b38257a4a.slice/crio-7e9705d7e99b549d745d93996e5939da6412849b75009b2d92769928d9eae35f WatchSource:0}: Error finding container 7e9705d7e99b549d745d93996e5939da6412849b75009b2d92769928d9eae35f: Status 404 returned error can't find the container with id 7e9705d7e99b549d745d93996e5939da6412849b75009b2d92769928d9eae35f Jul 20 23:01:34.060078 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.060045 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:34.060166 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.060111 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:34.060166 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.060153 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:34.609169 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.609136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerStarted","Data":"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c"} Jul 20 23:01:34.609342 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.609186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerStarted","Data":"7e9705d7e99b549d745d93996e5939da6412849b75009b2d92769928d9eae35f"} Jul 20 23:01:34.630450 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.630400 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podStartSLOduration=1.630383665 podStartE2EDuration="1.630383665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:34.628613065 +0000 UTC m=+2348.837446019" watchObservedRunningTime="2026-07-20 23:01:34.630383665 +0000 UTC m=+2348.839216594" Jul 20 23:01:34.913224 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:34.913135 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:35.918670 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:35.918638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:36.621035 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:36.621001 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:36.622101 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:36.622079 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:37.979319 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:37.979296 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 23:01:38.068777 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068744 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.068946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068819 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.068946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068858 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.068946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068881 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.068946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068910 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.068946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.068940 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqc6r\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069024 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069087 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069140 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069179 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069191 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert\") pod \"4b6d154d-31d4-4741-92ad-624eedcafb8f\" (UID: \"4b6d154d-31d4-4741-92ad-624eedcafb8f\") " Jul 20 23:01:38.069214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069193 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:38.069627 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069604 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:01:38.069735 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069708 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b6d154d-31d4-4741-92ad-624eedcafb8f-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.069735 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069733 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.069851 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069746 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.069851 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069760 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.069978 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.069960 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:38.071234 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.071209 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:01:38.071354 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.071328 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:01:38.071598 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.071573 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r" (OuterVolumeSpecName: "kube-api-access-jqc6r") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "kube-api-access-jqc6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:01:38.071696 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.071605 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b6d154d-31d4-4741-92ad-624eedcafb8f" (UID: "4b6d154d-31d4-4741-92ad-624eedcafb8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:01:38.170427 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.170393 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.170427 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.170421 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.170427 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.170429 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.170674 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.170437 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqc6r\" (UniqueName: \"kubernetes.io/projected/4b6d154d-31d4-4741-92ad-624eedcafb8f-kube-api-access-jqc6r\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.170674 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.170449 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b6d154d-31d4-4741-92ad-624eedcafb8f-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:01:38.633627 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.633588 2568 generic.go:356] "Generic (PLEG): container finished" podID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerID="3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726" exitCode=0 Jul 20 23:01:38.633809 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.633636 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" Jul 20 23:01:38.633809 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.633677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerDied","Data":"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726"} Jul 20 23:01:38.633809 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.633738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75" event={"ID":"4b6d154d-31d4-4741-92ad-624eedcafb8f","Type":"ContainerDied","Data":"5c73b2cf218e7d59c9ca9eff6adc3d6960c10410ae27784bed1925e7980b5305"} Jul 20 23:01:38.633809 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.633770 2568 scope.go:117] "RemoveContainer" containerID="3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726" Jul 20 23:01:38.643060 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.643044 2568 scope.go:117] "RemoveContainer" containerID="534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf" Jul 20 23:01:38.655783 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.655755 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 23:01:38.656850 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.656823 2568 scope.go:117] "RemoveContainer" containerID="3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726" Jul 20 23:01:38.657216 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:01:38.657188 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726\": container with ID starting with 3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726 not found: ID does not exist" containerID="3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726" Jul 20 23:01:38.657337 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.657233 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726"} err="failed to get container status \"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726\": rpc error: code = NotFound desc = could not find container \"3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726\": container with ID starting with 3899a3ea994e65c7f1f0e46b6316299b35a0c57d0eab66fb0f78df5b6e033726 not found: ID does not exist" Jul 20 23:01:38.657337 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.657258 2568 scope.go:117] "RemoveContainer" containerID="534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf" Jul 20 23:01:38.657617 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:01:38.657569 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf\": container with ID starting with 534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf not found: ID does not exist" containerID="534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf" Jul 20 23:01:38.657704 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.657609 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf"} err="failed to get container status \"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf\": rpc error: code = NotFound desc = could not find container \"534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf\": container with ID starting with 534dd9a2d076de23681027900af0d3241fccec807d5f701999928de8bfbefbaf not found: ID does not exist" Jul 20 23:01:38.661117 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:38.661095 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-35607f-openshift-default-6fbd4f7cbf-dnr75"] Jul 20 23:01:40.296259 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:40.296226 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" path="/var/lib/kubelet/pods/4b6d154d-31d4-4741-92ad-624eedcafb8f/volumes" Jul 20 23:01:41.747986 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.747953 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:01:41.748607 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748536 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.748607 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748557 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.748607 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748601 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:41.748791 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748612 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea18cff1-ba1f-479d-8872-2e9f51f2494f" containerName="istio-proxy" Jul 20 23:01:41.748791 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748624 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.748791 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748633 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.748791 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748727 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.748791 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.748742 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6d154d-31d4-4741-92ad-624eedcafb8f" containerName="istio-proxy" Jul 20 23:01:41.752995 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.752974 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.755853 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.755835 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-aae0e4-openshift-default-dockercfg-22bvc\"" Jul 20 23:01:41.765758 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.765734 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:01:41.907299 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907474 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907474 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907474 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907474 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907474 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907718 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907718 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:41.907718 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:41.907604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgn2\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008677 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008677 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008677 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008689 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.008977 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.008821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgn2\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.009276 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.009043 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.009276 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.009135 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.009276 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.009197 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.009276 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.009268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.009668 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.009650 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.010994 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.010971 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.011324 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.011306 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.016268 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.016249 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.016360 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.016282 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgn2\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2\") pod \"e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.066060 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.066027 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:42.209229 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.209196 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:01:42.210412 ip-10-0-135-161 kubenswrapper[2568]: W0720 23:01:42.210380 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28892967_f6e6_41e6_bc07_99012d5dc1ae.slice/crio-1788137ab30e9487ba3a5ef5763878e927e43231592708a4472df1baf1fd5f7d WatchSource:0}: Error finding container 1788137ab30e9487ba3a5ef5763878e927e43231592708a4472df1baf1fd5f7d: Status 404 returned error can't find the container with id 1788137ab30e9487ba3a5ef5763878e927e43231592708a4472df1baf1fd5f7d Jul 20 23:01:42.212464 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.212428 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:42.212592 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.212515 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:42.212592 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.212545 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:42.657719 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.657681 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerStarted","Data":"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff"} Jul 20 23:01:42.657916 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.657740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerStarted","Data":"1788137ab30e9487ba3a5ef5763878e927e43231592708a4472df1baf1fd5f7d"} Jul 20 23:01:42.678175 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:42.678127 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podStartSLOduration=1.678112429 podStartE2EDuration="1.678112429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:42.675439128 +0000 UTC m=+2356.884272060" watchObservedRunningTime="2026-07-20 23:01:42.678112429 +0000 UTC m=+2356.886945358" Jul 20 23:01:43.066961 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:43.066925 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:43.071928 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:43.071904 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:43.663917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:43.663881 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:43.664828 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:43.664809 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:01:51.622772 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.622735 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 23:01:51.623194 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.622793 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 23:01:51.711959 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.711927 2568 generic.go:356] "Generic (PLEG): container finished" podID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerID="88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c" exitCode=0 Jul 20 23:01:51.712119 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.711997 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerDied","Data":"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c"} Jul 20 23:01:51.712423 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.712405 2568 scope.go:117] "RemoveContainer" containerID="88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c" Jul 20 23:01:51.713417 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.713387 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:51.713490 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.713476 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:51.713609 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:51.713549 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:01:52.724751 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:52.724713 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerStarted","Data":"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326"} Jul 20 23:01:52.913566 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:52.913524 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:52.914382 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:52.914347 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 23:01:52.914633 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:52.914590 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 23:01:53.913357 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:53.913317 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 23:01:53.914011 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:53.913974 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 23:01:54.913046 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:54.912999 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 23:01:54.913258 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:54.913070 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 23:01:55.913808 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:55.913766 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 23:01:55.914391 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:55.914355 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 23:01:56.925132 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:56.925089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:56.925885 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:56.925827 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:56.929121 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:56.929099 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:01:59.706717 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:59.706672 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 23:01:59.707121 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:01:59.706742 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 23:02:00.786024 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.785990 2568 generic.go:356] "Generic (PLEG): container finished" podID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerID="00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff" exitCode=0 Jul 20 23:02:00.786024 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.786032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerDied","Data":"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff"} Jul 20 23:02:00.786634 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.786450 2568 scope.go:117] "RemoveContainer" containerID="00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff" Jul 20 23:02:00.787525 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.787469 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:00.787602 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.787582 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:00.787662 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:00.787645 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:01.797107 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:01.797066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerStarted","Data":"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b"} Jul 20 23:02:02.066267 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:02.066185 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:02.066446 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:02.066421 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 23:02:02.066526 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:02.066483 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 23:02:03.067369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:03.067331 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 23:02:03.067774 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:03.067390 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 23:02:04.066702 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:04.066664 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 23:02:04.066886 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:04.066733 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 23:02:05.067392 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:05.067347 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 23:02:05.067833 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:05.067424 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 23:02:06.070699 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:06.070667 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:06.071240 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:06.070969 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:06.071937 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:06.071910 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:23.537602 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:23.537571 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:02:23.538103 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:23.537783 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" containerID="cri-o://c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326" gracePeriod=30 Jul 20 23:02:26.490289 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:26.490255 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 23:02:26.500492 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:26.500472 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 23:02:26.928280 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:26.928239 2568 patch_prober.go:28] interesting pod/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 23:02:26.928444 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:26.928304 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 23:02:28.787826 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.787799 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:02:28.847975 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.847877 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.847975 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.847938 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.847975 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.847976 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848275 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848001 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848275 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848027 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848275 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848062 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848275 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848154 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:28.848275 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848157 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848543 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848286 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmcnt\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848543 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848302 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:28.848543 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848386 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:28.848543 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848417 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token\") pod \"39d2f579-0ba0-48fd-bbac-669b38257a4a\" (UID: \"39d2f579-0ba0-48fd-bbac-669b38257a4a\") " Jul 20 23:02:28.848543 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848523 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:02:28.848809 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848782 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.848861 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848805 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.848861 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848821 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.848861 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.848833 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39d2f579-0ba0-48fd-bbac-669b38257a4a-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.849081 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.849060 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:28.850288 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.850256 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:28.850431 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.850410 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:02:28.850727 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.850702 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:02:28.850822 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.850780 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt" (OuterVolumeSpecName: "kube-api-access-fmcnt") pod "39d2f579-0ba0-48fd-bbac-669b38257a4a" (UID: "39d2f579-0ba0-48fd-bbac-669b38257a4a"). InnerVolumeSpecName "kube-api-access-fmcnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:02:28.949889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.949842 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmcnt\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-kube-api-access-fmcnt\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.949889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.949884 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.949889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.949894 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.949889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.949902 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.949889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.949909 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39d2f579-0ba0-48fd-bbac-669b38257a4a-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:28.961378 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.961344 2568 generic.go:356] "Generic (PLEG): container finished" podID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerID="c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326" exitCode=0 Jul 20 23:02:28.961542 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.961401 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" Jul 20 23:02:28.961542 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.961428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerDied","Data":"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326"} Jul 20 23:02:28.961542 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.961488 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs" event={"ID":"39d2f579-0ba0-48fd-bbac-669b38257a4a","Type":"ContainerDied","Data":"7e9705d7e99b549d745d93996e5939da6412849b75009b2d92769928d9eae35f"} Jul 20 23:02:28.961542 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.961528 2568 scope.go:117] "RemoveContainer" containerID="c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326" Jul 20 23:02:28.971115 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.971093 2568 scope.go:117] "RemoveContainer" containerID="88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c" Jul 20 23:02:28.979213 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.979192 2568 scope.go:117] "RemoveContainer" containerID="c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326" Jul 20 23:02:28.979514 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:02:28.979482 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326\": container with ID starting with c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326 not found: ID does not exist" containerID="c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326" Jul 20 23:02:28.979598 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.979529 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326"} err="failed to get container status \"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326\": rpc error: code = NotFound desc = could not find container \"c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326\": container with ID starting with c4b5df1681fa3f6fd4c884d9c990951610efbd3969f59241bb497b3e229f5326 not found: ID does not exist" Jul 20 23:02:28.979598 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.979548 2568 scope.go:117] "RemoveContainer" containerID="88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c" Jul 20 23:02:28.979792 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:02:28.979774 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c\": container with ID starting with 88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c not found: ID does not exist" containerID="88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c" Jul 20 23:02:28.979835 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.979800 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c"} err="failed to get container status \"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c\": rpc error: code = NotFound desc = could not find container \"88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c\": container with ID starting with 88deb18b4eeb53555cbb245e896b89a2d9b74cba404c5b265f166da1e42be00c not found: ID does not exist" Jul 20 23:02:28.983564 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.983532 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:02:28.985841 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:28.985816 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-238953-openshift-default-5b97f85487-mmdxs"] Jul 20 23:02:30.296627 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:30.296582 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" path="/var/lib/kubelet/pods/39d2f579-0ba0-48fd-bbac-669b38257a4a/volumes" Jul 20 23:02:50.420043 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:50.419942 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:02:50.420585 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:50.420192 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" containerID="cri-o://04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b" gracePeriod=30 Jul 20 23:02:51.073706 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.073671 2568 patch_prober.go:28] interesting pod/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 23:02:51.073893 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.073728 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 23:02:51.219766 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.219726 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:02:51.220214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220195 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.220214 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220211 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.220384 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220223 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.220384 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220229 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.220384 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220306 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.220384 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.220316 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d2f579-0ba0-48fd-bbac-669b38257a4a" containerName="istio-proxy" Jul 20 23:02:51.223522 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.223485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.226261 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.226231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-717ec3-openshift-default-dockercfg-sk89h\"" Jul 20 23:02:51.235659 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.235634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:02:51.253646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253615 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqw24\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.253980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.253818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354524 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354524 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354779 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354779 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354779 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354779 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqw24\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354994 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354994 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354994 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354888 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.354994 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.354893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.355310 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.355257 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.355310 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.355276 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.355541 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.355517 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.355611 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.355550 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.357132 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.357102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.357385 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.357369 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.365254 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.365169 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.365574 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.365548 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqw24\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24\") pod \"e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.535397 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.535364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:51.672084 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.672060 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:02:51.674019 ip-10-0-135-161 kubenswrapper[2568]: W0720 23:02:51.673988 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb339d859_23ac_4446_8fef_e0de16cd12c2.slice/crio-f21b6f8f55a26039845ab7f910492ac18fd36e813ed1c061ddae2df6e8802812 WatchSource:0}: Error finding container f21b6f8f55a26039845ab7f910492ac18fd36e813ed1c061ddae2df6e8802812: Status 404 returned error can't find the container with id f21b6f8f55a26039845ab7f910492ac18fd36e813ed1c061ddae2df6e8802812 Jul 20 23:02:51.676180 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.676146 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:51.676251 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.676215 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:51.676251 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:51.676243 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:52.093665 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:52.093622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerStarted","Data":"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e"} Jul 20 23:02:52.093875 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:52.093696 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerStarted","Data":"f21b6f8f55a26039845ab7f910492ac18fd36e813ed1c061ddae2df6e8802812"} Jul 20 23:02:52.113118 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:52.113065 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podStartSLOduration=1.11305137 podStartE2EDuration="1.11305137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:02:52.111140782 +0000 UTC m=+2426.319973725" watchObservedRunningTime="2026-07-20 23:02:52.11305137 +0000 UTC m=+2426.321884298" Jul 20 23:02:52.535797 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:52.535713 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:52.541324 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:52.541297 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:53.099070 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:53.099036 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:53.100042 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:53.100019 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:02:55.679064 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.679037 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:55.796849 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796820 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796872 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796891 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796919 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfgn2\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796943 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796965 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797004 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.796982 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797308 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797092 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797308 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797120 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo\") pod \"28892967-f6e6-41e6-bc07-99012d5dc1ae\" (UID: \"28892967-f6e6-41e6-bc07-99012d5dc1ae\") " Jul 20 23:02:55.797308 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797149 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:55.797308 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797165 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:55.797641 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797353 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:55.797748 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797563 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:02:55.797748 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797468 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.797889 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797748 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.798012 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.797987 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:55.799292 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.799260 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:02:55.799292 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.799279 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2" (OuterVolumeSpecName: "kube-api-access-gfgn2") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "kube-api-access-gfgn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:02:55.799560 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.799545 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:02:55.799612 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.799565 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28892967-f6e6-41e6-bc07-99012d5dc1ae" (UID: "28892967-f6e6-41e6-bc07-99012d5dc1ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:02:55.898997 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.898967 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28892967-f6e6-41e6-bc07-99012d5dc1ae-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.898997 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.898994 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.898997 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.899003 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.899223 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.899011 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfgn2\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-kube-api-access-gfgn2\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.899223 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.899021 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.899223 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.899029 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:55.899223 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:55.899038 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28892967-f6e6-41e6-bc07-99012d5dc1ae-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:02:56.122170 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.122070 2568 generic.go:356] "Generic (PLEG): container finished" podID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerID="04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b" exitCode=0 Jul 20 23:02:56.122170 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.122109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerDied","Data":"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b"} Jul 20 23:02:56.122170 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.122131 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" Jul 20 23:02:56.122170 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.122153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx" event={"ID":"28892967-f6e6-41e6-bc07-99012d5dc1ae","Type":"ContainerDied","Data":"1788137ab30e9487ba3a5ef5763878e927e43231592708a4472df1baf1fd5f7d"} Jul 20 23:02:56.122523 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.122177 2568 scope.go:117] "RemoveContainer" containerID="04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b" Jul 20 23:02:56.134467 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.134446 2568 scope.go:117] "RemoveContainer" containerID="00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff" Jul 20 23:02:56.142826 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.142809 2568 scope.go:117] "RemoveContainer" containerID="04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b" Jul 20 23:02:56.143092 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:02:56.143073 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b\": container with ID starting with 04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b not found: ID does not exist" containerID="04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b" Jul 20 23:02:56.143145 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.143101 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b"} err="failed to get container status \"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b\": rpc error: code = NotFound desc = could not find container \"04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b\": container with ID starting with 04fa53f370d562813cc17ec2993f65314f698f07872bab951d555bf1c636592b not found: ID does not exist" Jul 20 23:02:56.143145 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.143120 2568 scope.go:117] "RemoveContainer" containerID="00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff" Jul 20 23:02:56.143357 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:02:56.143338 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff\": container with ID starting with 00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff not found: ID does not exist" containerID="00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff" Jul 20 23:02:56.143412 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.143358 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff"} err="failed to get container status \"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff\": rpc error: code = NotFound desc = could not find container \"00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff\": container with ID starting with 00693ef70fe8f0467f8fb89aa9c7be7bcf8c7701382801d58deaceed6462d0ff not found: ID does not exist" Jul 20 23:02:56.147101 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.147078 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:02:56.151186 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.151168 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-aae0e4-openshift-default-868bb6f96f-q8ctx"] Jul 20 23:02:56.296940 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:56.296909 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" path="/var/lib/kubelet/pods/28892967-f6e6-41e6-bc07-99012d5dc1ae/volumes" Jul 20 23:02:59.111990 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.111940 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:02:59.112477 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112450 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.112477 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112466 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.112636 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112493 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.112636 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112519 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.112636 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112586 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.112636 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.112601 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="28892967-f6e6-41e6-bc07-99012d5dc1ae" containerName="istio-proxy" Jul 20 23:02:59.117077 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.117054 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.120297 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.120255 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1dd4fb-openshift-default-dockercfg-hl28b\"" Jul 20 23:02:59.127361 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.127338 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:02:59.231670 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvhj\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.231670 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231666 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.231919 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.231919 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.231919 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.232032 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231943 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.232032 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.231987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.232130 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.232056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.232130 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.232108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333089 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvhj\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333302 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333302 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333302 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333460 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333460 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333460 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333658 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333658 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333658 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333635 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333839 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333674 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333839 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333760 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.333950 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.333887 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.334070 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.334050 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.335744 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.335724 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.336139 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.336120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.341831 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.341798 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.342324 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.342305 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvhj\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj\") pod \"e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.428587 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.428475 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:02:59.575967 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.575916 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:02:59.577938 ip-10-0-135-161 kubenswrapper[2568]: W0720 23:02:59.577904 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aad5c4_4f09_40ce_8eb9_0fae75a954d3.slice/crio-55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1 WatchSource:0}: Error finding container 55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1: Status 404 returned error can't find the container with id 55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1 Jul 20 23:02:59.580279 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.580245 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:59.580368 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.580340 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:02:59.580417 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:02:59.580368 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:00.147307 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:00.147270 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerStarted","Data":"96dabbe41564df5a969d593beec8cdc5fbc4a34258e1418c864971d2fc07a323"} Jul 20 23:03:00.147720 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:00.147333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerStarted","Data":"55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1"} Jul 20 23:03:00.174159 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:00.174101 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podStartSLOduration=1.174079698 podStartE2EDuration="1.174079698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:03:00.17010838 +0000 UTC m=+2434.378941310" watchObservedRunningTime="2026-07-20 23:03:00.174079698 +0000 UTC m=+2434.382912628" Jul 20 23:03:00.429754 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:00.429647 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:00.435161 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:00.435135 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:01.156337 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:01.156297 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:01.160044 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:01.160017 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:08.100364 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.100327 2568 patch_prober.go:28] interesting pod/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 20 23:03:08.100854 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.100398 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 20 23:03:08.196294 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.196260 2568 generic.go:356] "Generic (PLEG): container finished" podID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerID="bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e" exitCode=0 Jul 20 23:03:08.196471 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.196329 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerDied","Data":"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e"} Jul 20 23:03:08.196819 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.196801 2568 scope.go:117] "RemoveContainer" containerID="bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e" Jul 20 23:03:08.197935 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.197900 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:08.198010 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.197994 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:08.198050 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:08.198032 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:09.204235 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:09.204197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerStarted","Data":"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6"} Jul 20 23:03:09.535639 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:09.535525 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:03:09.536013 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:09.535980 2568 patch_prober.go:28] interesting pod/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 20 23:03:09.536137 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:09.536042 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 20 23:03:10.536210 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:10.536161 2568 patch_prober.go:28] interesting pod/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 20 23:03:10.536761 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:10.536244 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 20 23:03:11.536523 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:11.536463 2568 patch_prober.go:28] interesting pod/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 20 23:03:11.537059 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:11.536553 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 20 23:03:12.536609 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:12.536556 2568 patch_prober.go:28] interesting pod/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 20 23:03:12.537114 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:12.536671 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 20 23:03:13.540489 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:13.540457 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:03:13.540987 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:13.540904 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:03:13.541611 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:13.541588 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:03:16.157882 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.157840 2568 patch_prober.go:28] interesting pod/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 23:03:16.158413 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.157921 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 23:03:16.260841 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.260806 2568 generic.go:356] "Generic (PLEG): container finished" podID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerID="96dabbe41564df5a969d593beec8cdc5fbc4a34258e1418c864971d2fc07a323" exitCode=0 Jul 20 23:03:16.261028 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.260870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerDied","Data":"96dabbe41564df5a969d593beec8cdc5fbc4a34258e1418c864971d2fc07a323"} Jul 20 23:03:16.261279 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.261257 2568 scope.go:117] "RemoveContainer" containerID="96dabbe41564df5a969d593beec8cdc5fbc4a34258e1418c864971d2fc07a323" Jul 20 23:03:16.262237 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.262206 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:16.262338 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.262276 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:16.262338 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:16.262307 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 20 23:03:17.268326 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:17.268287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerStarted","Data":"ef9140f4ac3b83cbb5eb16b445d52a78baf394bb9be150cbab805dd949720ae7"} Jul 20 23:03:17.429050 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:17.429005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:17.429299 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:17.429271 2568 patch_prober.go:28] interesting pod/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 23:03:17.429371 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:17.429347 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 23:03:18.429768 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:18.429729 2568 patch_prober.go:28] interesting pod/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 23:03:18.430250 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:18.429807 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 23:03:19.429321 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:19.429276 2568 patch_prober.go:28] interesting pod/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 23:03:19.429577 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:19.429348 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 23:03:20.429925 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:20.429879 2568 patch_prober.go:28] interesting pod/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 20 23:03:20.430339 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:20.429956 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 20 23:03:21.432980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:21.432950 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:21.433348 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:21.433318 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:03:21.433911 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:03:21.433893 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:07:26.526304 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:07:26.526278 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 23:07:26.536798 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:07:26.536778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 23:09:33.348892 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:33.348856 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:09:33.349380 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:33.349111 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" containerID="cri-o://e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6" gracePeriod=30 Jul 20 23:09:38.594827 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.594803 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:09:38.711136 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711050 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711136 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711116 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711147 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711184 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711206 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711222 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711247 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711282 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711369 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711333 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqw24\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24\") pod \"b339d859-23ac-4446-8fef-e0de16cd12c2\" (UID: \"b339d859-23ac-4446-8fef-e0de16cd12c2\") " Jul 20 23:09:38.711774 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711551 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:09:38.711774 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711630 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:09:38.711774 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711741 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.711927 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711763 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b339d859-23ac-4446-8fef-e0de16cd12c2-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.711927 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711827 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:09:38.711927 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.711860 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:09:38.712075 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.712047 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:09:38.713451 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.713422 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:09:38.713603 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.713516 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:09:38.713902 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.713881 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24" (OuterVolumeSpecName: "kube-api-access-mqw24") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "kube-api-access-mqw24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:09:38.713943 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.713903 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b339d859-23ac-4446-8fef-e0de16cd12c2" (UID: "b339d859-23ac-4446-8fef-e0de16cd12c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:09:38.812769 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812732 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812769 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812763 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812769 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812772 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqw24\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-kube-api-access-mqw24\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812999 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812782 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812999 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812790 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812999 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812798 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b339d859-23ac-4446-8fef-e0de16cd12c2-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:38.812999 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:38.812805 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b339d859-23ac-4446-8fef-e0de16cd12c2-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:09:39.364003 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.363968 2568 generic.go:356] "Generic (PLEG): container finished" podID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerID="e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6" exitCode=0 Jul 20 23:09:39.364179 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.364015 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" Jul 20 23:09:39.364179 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.364042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerDied","Data":"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6"} Jul 20 23:09:39.364179 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.364084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms" event={"ID":"b339d859-23ac-4446-8fef-e0de16cd12c2","Type":"ContainerDied","Data":"f21b6f8f55a26039845ab7f910492ac18fd36e813ed1c061ddae2df6e8802812"} Jul 20 23:09:39.364179 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.364106 2568 scope.go:117] "RemoveContainer" containerID="e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6" Jul 20 23:09:39.374082 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.374061 2568 scope.go:117] "RemoveContainer" containerID="bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e" Jul 20 23:09:39.382255 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.382228 2568 scope.go:117] "RemoveContainer" containerID="e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6" Jul 20 23:09:39.382493 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:09:39.382474 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6\": container with ID starting with e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6 not found: ID does not exist" containerID="e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6" Jul 20 23:09:39.382559 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.382517 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6"} err="failed to get container status \"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6\": rpc error: code = NotFound desc = could not find container \"e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6\": container with ID starting with e306a673838c0eb8fd2d02d250271f4f29df5811cc746a1204f68a64b2708db6 not found: ID does not exist" Jul 20 23:09:39.382559 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.382534 2568 scope.go:117] "RemoveContainer" containerID="bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e" Jul 20 23:09:39.382768 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:09:39.382747 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e\": container with ID starting with bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e not found: ID does not exist" containerID="bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e" Jul 20 23:09:39.382805 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.382775 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e"} err="failed to get container status \"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e\": rpc error: code = NotFound desc = could not find container \"bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e\": container with ID starting with bf8a891c55161c659d89b346fb2aa0fdb828ad4982573e8c6fbe26e0508fb86e not found: ID does not exist" Jul 20 23:09:39.386630 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.386609 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:09:39.394167 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:39.394137 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-717ec3-openshift-default-7c479b7b47-9fcms"] Jul 20 23:09:40.296666 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:40.296629 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" path="/var/lib/kubelet/pods/b339d859-23ac-4446-8fef-e0de16cd12c2/volumes" Jul 20 23:09:55.278141 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:55.278108 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:09:55.278634 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:09:55.278323 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" containerID="cri-o://ef9140f4ac3b83cbb5eb16b445d52a78baf394bb9be150cbab805dd949720ae7" gracePeriod=30 Jul 20 23:10:00.482690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.482658 2568 generic.go:356] "Generic (PLEG): container finished" podID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerID="ef9140f4ac3b83cbb5eb16b445d52a78baf394bb9be150cbab805dd949720ae7" exitCode=0 Jul 20 23:10:00.483027 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.482729 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerDied","Data":"ef9140f4ac3b83cbb5eb16b445d52a78baf394bb9be150cbab805dd949720ae7"} Jul 20 23:10:00.483027 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.482799 2568 scope.go:117] "RemoveContainer" containerID="96dabbe41564df5a969d593beec8cdc5fbc4a34258e1418c864971d2fc07a323" Jul 20 23:10:00.535790 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.535762 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:10:00.617983 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.617946 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jvhj\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618162 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618000 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618162 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618057 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618162 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618116 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618162 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618151 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618312 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618208 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618312 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618237 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618312 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618301 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618443 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618339 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy\") pod \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\" (UID: \"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3\") " Jul 20 23:10:00.618535 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618426 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:10:00.618651 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618616 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:10:00.618781 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618762 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-credential-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.618849 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618789 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-socket\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.618849 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618764 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 23:10:00.618980 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.618841 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:10:00.619054 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.619029 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:10:00.620327 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.620305 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 23:10:00.620687 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.620656 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:10:00.620781 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.620702 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 23:10:00.620781 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.620728 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj" (OuterVolumeSpecName: "kube-api-access-2jvhj") pod "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" (UID: "e0aad5c4-4f09-40ce-8eb9-0fae75a954d3"). InnerVolumeSpecName "kube-api-access-2jvhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 23:10:00.720032 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.719997 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-podinfo\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720032 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720027 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-workload-certs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720032 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720037 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720260 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720047 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istiod-ca-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720260 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720056 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-envoy\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720260 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720064 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jvhj\" (UniqueName: \"kubernetes.io/projected/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-kube-api-access-2jvhj\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:00.720260 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:00.720076 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3-istio-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\"" Jul 20 23:10:01.488995 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.488964 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" Jul 20 23:10:01.489456 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.489005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5" event={"ID":"e0aad5c4-4f09-40ce-8eb9-0fae75a954d3","Type":"ContainerDied","Data":"55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1"} Jul 20 23:10:01.489456 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.489058 2568 scope.go:117] "RemoveContainer" containerID="ef9140f4ac3b83cbb5eb16b445d52a78baf394bb9be150cbab805dd949720ae7" Jul 20 23:10:01.518633 ip-10-0-135-161 kubenswrapper[2568]: E0720 23:10:01.518602 2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aad5c4_4f09_40ce_8eb9_0fae75a954d3.slice/crio-55b9cc194359fb9f47df9402b36ce8c747f997e1733df2122a7d20814f3f18a1\": RecentStats: unable to find data in memory cache]" Jul 20 23:10:01.520156 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.520133 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:10:01.525136 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.525108 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1dd4fb-openshift-default-55f4664fd7-lstb5"] Jul 20 23:10:01.546109 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.546078 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-794dc66cdb-rh5rs_5e038aad-b278-46c6-8453-8130005257a6/manager/0.log" Jul 20 23:10:01.662627 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.662594 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t2696_a1a621e3-96de-42cc-8f3b-df2f37df167a/server/0.log" Jul 20 23:10:01.882982 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.882953 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-56wgl_d3834534-d08e-4fc4-aa3a-db0d470e8595/copy-manifests/0.log" Jul 20 23:10:01.895172 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:01.895144 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-56wgl_d3834534-d08e-4fc4-aa3a-db0d470e8595/manager/0.log" Jul 20 23:10:02.298564 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:02.298524 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" path="/var/lib/kubelet/pods/e0aad5c4-4f09-40ce-8eb9-0fae75a954d3/volumes" Jul 20 23:10:02.588256 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:02.588172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743125-jf988_fb1d2ea0-108c-4bcd-b937-ba6020dd2dbc/cleanup/0.log" Jul 20 23:10:02.799259 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:02.799228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cktng_d30ec827-ee3f-4293-acfe-197202de9d1d/postgres/0.log" Jul 20 23:10:03.558799 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.558765 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/extract/0.log" Jul 20 23:10:03.566064 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.566043 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/util/0.log" Jul 20 23:10:03.571898 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.571860 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/pull/0.log" Jul 20 23:10:03.679233 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.679206 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/util/0.log" Jul 20 23:10:03.685517 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.685444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/pull/0.log" Jul 20 23:10:03.691488 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.691441 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/extract/0.log" Jul 20 23:10:03.805429 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.805402 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/extract/0.log" Jul 20 23:10:03.811959 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.811891 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/util/0.log" Jul 20 23:10:03.818685 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.818657 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/pull/0.log" Jul 20 23:10:03.931800 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.931769 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/util/0.log" Jul 20 23:10:03.937983 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.937960 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/pull/0.log" Jul 20 23:10:03.943965 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:03.943941 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/extract/0.log" Jul 20 23:10:04.181670 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:04.181582 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-szfz6_7a2cd5e0-5d58-4823-937c-1226e2024cf7/manager/0.log" Jul 20 23:10:04.398991 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:04.398964 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zsjf4_9fea82c8-d5ef-46d7-96b1-1770aedecbbc/kuadrant-console-plugin/0.log" Jul 20 23:10:04.512165 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:04.512091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nm9jp_4c77184c-1b38-4420-8146-db7177009d90/registry-server/0.log" Jul 20 23:10:05.193066 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:05.193040 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678x269b_7753fa81-93c7-4c60-b9ac-2311ccb489b6/istio-proxy/0.log" Jul 20 23:10:05.642122 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:05.642092 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/1.log" Jul 20 23:10:05.752454 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:05.752407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t4hf4_186771ae-c742-409e-a72c-0f3c28044d48/payload-pre-processing/0.log" Jul 20 23:10:05.866311 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:05.866280 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-pdlb4_36884052-c028-4828-a806-cd89d25ce7cd/payload-processing/0.log" Jul 20 23:10:06.321916 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:06.321891 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fzl4m_71c7d7e4-a90f-4165-8692-4a364c721f48/main/0.log" Jul 20 23:10:06.547233 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:06.547202 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wssx5_5116a772-41a5-4f33-88c1-7092a5ec8462/main/0.log" Jul 20 23:10:12.405238 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405203 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drpjk/must-gather-pdkrx"] Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405601 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405614 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405633 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405639 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405647 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405690 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405652 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405727 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405736 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405745 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405751 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0aad5c4-4f09-40ce-8eb9-0fae75a954d3" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405826 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.405917 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.405833 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b339d859-23ac-4446-8fef-e0de16cd12c2" containerName="istio-proxy" Jul 20 23:10:12.409232 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.409213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.411684 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.411658 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpjk\"/\"kube-root-ca.crt\"" Jul 20 23:10:12.411684 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.411654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-drpjk\"/\"default-dockercfg-bdb5w\"" Jul 20 23:10:12.412340 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.412322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpjk\"/\"openshift-service-ca.crt\"" Jul 20 23:10:12.418092 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.418067 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/must-gather-pdkrx"] Jul 20 23:10:12.519313 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.519271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2db9cb12-7892-4987-a139-71b3387cc642-must-gather-output\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.519313 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.519325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcs7x\" (UniqueName: \"kubernetes.io/projected/2db9cb12-7892-4987-a139-71b3387cc642-kube-api-access-fcs7x\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.620454 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.620419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2db9cb12-7892-4987-a139-71b3387cc642-must-gather-output\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.620668 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.620462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcs7x\" (UniqueName: \"kubernetes.io/projected/2db9cb12-7892-4987-a139-71b3387cc642-kube-api-access-fcs7x\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.620804 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.620783 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2db9cb12-7892-4987-a139-71b3387cc642-must-gather-output\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.628033 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.628007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcs7x\" (UniqueName: \"kubernetes.io/projected/2db9cb12-7892-4987-a139-71b3387cc642-kube-api-access-fcs7x\") pod \"must-gather-pdkrx\" (UID: \"2db9cb12-7892-4987-a139-71b3387cc642\") " pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.719934 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.719847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/must-gather-pdkrx" Jul 20 23:10:12.853178 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.853151 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/must-gather-pdkrx"] Jul 20 23:10:12.855131 ip-10-0-135-161 kubenswrapper[2568]: W0720 23:10:12.855107 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2db9cb12_7892_4987_a139_71b3387cc642.slice/crio-d337e03d01f56b55e31662ee6e1171d4362fcca496db4448b6b715d4d03342d8 WatchSource:0}: Error finding container d337e03d01f56b55e31662ee6e1171d4362fcca496db4448b6b715d4d03342d8: Status 404 returned error can't find the container with id d337e03d01f56b55e31662ee6e1171d4362fcca496db4448b6b715d4d03342d8 Jul 20 23:10:12.857310 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:12.857293 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 23:10:13.556919 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:13.556882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/must-gather-pdkrx" event={"ID":"2db9cb12-7892-4987-a139-71b3387cc642","Type":"ContainerStarted","Data":"d337e03d01f56b55e31662ee6e1171d4362fcca496db4448b6b715d4d03342d8"} Jul 20 23:10:14.565259 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:14.565213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/must-gather-pdkrx" event={"ID":"2db9cb12-7892-4987-a139-71b3387cc642","Type":"ContainerStarted","Data":"6a8be6018024f83b96a1553fe1fe786631670ef1e8099d99e6087b4f0816752d"} Jul 20 23:10:14.565778 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:14.565276 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/must-gather-pdkrx" event={"ID":"2db9cb12-7892-4987-a139-71b3387cc642","Type":"ContainerStarted","Data":"477b63a2ec6aa9733bf6cfc450e7fb174dca3a9b47c33b4334d7e7e6eee38922"} Jul 20 23:10:14.583102 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:14.583033 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drpjk/must-gather-pdkrx" podStartSLOduration=1.821420083 podStartE2EDuration="2.583012058s" totalImagesPullingTime="761.591975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:10:14.580381202 +0000 UTC m=+2868.789214134" watchObservedRunningTime="2026-07-20 23:10:14.583012058 +0000 UTC m=+2868.791844988" Jul 20 23:10:15.180311 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:15.180271 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bdhpr_59eb8778-ed6a-427f-b98d-6ffcc3665bef/global-pull-secret-syncer/0.log" Jul 20 23:10:15.285368 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:15.285338 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r94n7_8eb2ae2b-3744-406a-8b23-f65bee68b036/konnectivity-agent/0.log" Jul 20 23:10:15.350643 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:15.350610 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-161.ec2.internal_5912a6b56bf9d0fef039c45d63f074fe/haproxy/0.log" Jul 20 23:10:20.256642 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.256532 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/extract/0.log" Jul 20 23:10:20.278600 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.278568 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/util/0.log" Jul 20 23:10:20.302227 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.302199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m8ttd_dc261391-19dc-4bbe-b20e-9a4bc4f60879/pull/0.log" Jul 20 23:10:20.337225 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.337183 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/extract/0.log" Jul 20 23:10:20.360115 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.360091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/util/0.log" Jul 20 23:10:20.380825 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.380786 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sxmkr_b537074a-4edc-4d81-9ae9-714c04889fce/pull/0.log" Jul 20 23:10:20.433054 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.433013 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/extract/0.log" Jul 20 23:10:20.453773 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.453740 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/util/0.log" Jul 20 23:10:20.478354 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.478310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk8fl_747656e7-f5bc-47d4-a6db-e6cb07d33567/pull/0.log" Jul 20 23:10:20.509955 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.509876 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/extract/0.log" Jul 20 23:10:20.531122 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.531093 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/util/0.log" Jul 20 23:10:20.551094 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.551062 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n22j8_b5ca80c8-1096-4fb0-a3df-dde9cf6956c6/pull/0.log" Jul 20 23:10:20.963314 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:20.963275 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-szfz6_7a2cd5e0-5d58-4823-937c-1226e2024cf7/manager/0.log" Jul 20 23:10:21.016319 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:21.016288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zsjf4_9fea82c8-d5ef-46d7-96b1-1770aedecbbc/kuadrant-console-plugin/0.log" Jul 20 23:10:21.064444 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:21.064305 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nm9jp_4c77184c-1b38-4420-8146-db7177009d90/registry-server/0.log" Jul 20 23:10:23.415646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.415616 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7htg_56a51c34-4e11-4f3e-8767-417c0905ec3d/node-exporter/0.log" Jul 20 23:10:23.439480 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.439439 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7htg_56a51c34-4e11-4f3e-8767-417c0905ec3d/kube-rbac-proxy/0.log" Jul 20 23:10:23.461021 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.460980 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7htg_56a51c34-4e11-4f3e-8767-417c0905ec3d/init-textfile/0.log" Jul 20 23:10:23.786073 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.785989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b97bf7848-wgsvh_aa79df3d-a4b9-4b53-b919-81d35e947bf8/telemeter-client/0.log" Jul 20 23:10:23.805121 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.805084 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b97bf7848-wgsvh_aa79df3d-a4b9-4b53-b919-81d35e947bf8/reload/0.log" Jul 20 23:10:23.829203 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:23.829176 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b97bf7848-wgsvh_aa79df3d-a4b9-4b53-b919-81d35e947bf8/kube-rbac-proxy/0.log" Jul 20 23:10:25.132919 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.132893 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-knv8l_48c86637-2949-4721-a47d-28542394c2cb/networking-console-plugin/0.log" Jul 20 23:10:25.188218 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.188176 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb"] Jul 20 23:10:25.197063 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.197035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.202434 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.202405 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb"] Jul 20 23:10:25.256273 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.256233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-sys\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.256475 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.256293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-proc\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.256475 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.256337 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-lib-modules\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.256475 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.256366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-podres\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.256475 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.256426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kshgd\" (UniqueName: \"kubernetes.io/projected/042511dc-c6ea-4d01-8fad-576dc3e291ce-kube-api-access-kshgd\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357173 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-sys\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357173 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-proc\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357420 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-lib-modules\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357420 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-podres\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357420 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357272 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-sys\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357420 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kshgd\" (UniqueName: \"kubernetes.io/projected/042511dc-c6ea-4d01-8fad-576dc3e291ce-kube-api-access-kshgd\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357420 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357337 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-proc\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357669 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357435 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-podres\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.357669 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.357520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/042511dc-c6ea-4d01-8fad-576dc3e291ce-lib-modules\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.365082 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.365054 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kshgd\" (UniqueName: \"kubernetes.io/projected/042511dc-c6ea-4d01-8fad-576dc3e291ce-kube-api-access-kshgd\") pod \"perf-node-gather-daemonset-bc7sb\" (UID: \"042511dc-c6ea-4d01-8fad-576dc3e291ce\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.518347 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.518261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:25.729724 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.729696 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb"] Jul 20 23:10:25.829547 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.829521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/2.log" Jul 20 23:10:25.835525 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:25.835210 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-flxwd_dcc5d8bd-acce-4a08-9abe-d2f22d383a74/console-operator/3.log" Jul 20 23:10:26.329284 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.329254 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9c756f7c-qxnwt_3f5149ec-1235-4114-b0c2-b5cfd1d9fc95/console/0.log" Jul 20 23:10:26.362142 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.362100 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6vcvs_9001bc55-1841-44ab-9cdb-41ca869231e4/download-server/0.log" Jul 20 23:10:26.668683 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.668577 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" event={"ID":"042511dc-c6ea-4d01-8fad-576dc3e291ce","Type":"ContainerStarted","Data":"cd830fa0573bc5f7fec808a59dfb2c681a82033f0d8bcffb7c39da880be11aed"} Jul 20 23:10:26.668683 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.668654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" event={"ID":"042511dc-c6ea-4d01-8fad-576dc3e291ce","Type":"ContainerStarted","Data":"4d5269413612d307ff42d673e6f4a4305af6222ef598efd6606563c4bb5d94e0"} Jul 20 23:10:26.669513 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.669466 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:26.688847 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:26.688780 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" podStartSLOduration=1.6887562969999999 podStartE2EDuration="1.688756297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 23:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:10:26.685759927 +0000 UTC m=+2880.894592857" watchObservedRunningTime="2026-07-20 23:10:26.688756297 +0000 UTC m=+2880.897589227" Jul 20 23:10:28.026279 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:28.026241 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhw9z_b20fff44-09ae-4ccb-9657-81176d44e6c0/dns/0.log" Jul 20 23:10:28.045122 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:28.045098 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhw9z_b20fff44-09ae-4ccb-9657-81176d44e6c0/kube-rbac-proxy/0.log" Jul 20 23:10:28.135705 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:28.135672 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7vfn_2cad7217-fd46-4330-9c5e-dbc161db2c99/dns-node-resolver/0.log" Jul 20 23:10:28.754625 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:28.754599 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h4t8p_3184e18c-7a22-4b5a-8352-ced764119842/node-ca/0.log" Jul 20 23:10:29.660741 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:29.660694 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678x269b_7753fa81-93c7-4c60-b9ac-2311ccb489b6/istio-proxy/0.log" Jul 20 23:10:29.858594 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:29.858557 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/0.log" Jul 20 23:10:29.895738 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:29.895687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/1.log" Jul 20 23:10:29.930757 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:29.930629 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t4hf4_186771ae-c742-409e-a72c-0f3c28044d48/payload-pre-processing/0.log" Jul 20 23:10:29.960247 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:29.960212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-pdlb4_36884052-c028-4828-a806-cd89d25ce7cd/payload-processing/0.log" Jul 20 23:10:30.690566 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:30.690534 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwrf6_b865abc4-a59d-4a77-9433-c5da966704b2/serve-healthcheck-canary/0.log" Jul 20 23:10:31.189664 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:31.189616 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-zk8ph_5840144e-ef60-4fdb-9ab4-63f0754ec0da/insights-operator/0.log" Jul 20 23:10:31.190241 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:31.190211 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-zk8ph_5840144e-ef60-4fdb-9ab4-63f0754ec0da/insights-operator/1.log" Jul 20 23:10:31.277580 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:31.277548 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcnjf_5b57b631-5b04-4b6d-bb24-6d68c7c58fef/kube-rbac-proxy/0.log" Jul 20 23:10:31.298353 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:31.298324 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcnjf_5b57b631-5b04-4b6d-bb24-6d68c7c58fef/exporter/0.log" Jul 20 23:10:31.318909 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:31.318877 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcnjf_5b57b631-5b04-4b6d-bb24-6d68c7c58fef/extractor/0.log" Jul 20 23:10:33.695139 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:33.695113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-bc7sb" Jul 20 23:10:33.840390 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:33.840355 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-794dc66cdb-rh5rs_5e038aad-b278-46c6-8453-8130005257a6/manager/0.log" Jul 20 23:10:33.859984 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:33.859956 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t2696_a1a621e3-96de-42cc-8f3b-df2f37df167a/server/0.log" Jul 20 23:10:34.028946 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:34.028860 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-56wgl_d3834534-d08e-4fc4-aa3a-db0d470e8595/manager/0.log" Jul 20 23:10:34.045403 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:34.045370 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-56wgl_d3834534-d08e-4fc4-aa3a-db0d470e8595/copy-manifests/0.log" Jul 20 23:10:35.434684 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.434650 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678x269b_7753fa81-93c7-4c60-b9ac-2311ccb489b6/istio-proxy/0.log" Jul 20 23:10:35.503614 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.503477 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f85f98759-4m4ws_8bcd887c-ccbf-4a1a-a84f-2a9df3f4f2b0/manager/0.log" Jul 20 23:10:35.556759 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.556638 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pjp5l_46e37220-a608-48c4-b176-918b622237a0/openshift-lws-operator/0.log" Jul 20 23:10:35.607479 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.607444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/0.log" Jul 20 23:10:35.644580 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.643355 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/1.log" Jul 20 23:10:35.668707 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.668673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t4hf4_186771ae-c742-409e-a72c-0f3c28044d48/payload-pre-processing/0.log" Jul 20 23:10:35.696839 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:35.696804 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-pdlb4_36884052-c028-4828-a806-cd89d25ce7cd/payload-processing/0.log" Jul 20 23:10:36.993143 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:36.993038 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678x269b_7753fa81-93c7-4c60-b9ac-2311ccb489b6/istio-proxy/0.log" Jul 20 23:10:37.153820 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:37.153788 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/0.log" Jul 20 23:10:37.188216 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:37.188182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4xhjq_79d04105-61e3-4f26-84ee-c5306c8121a4/istio-proxy/1.log" Jul 20 23:10:37.215616 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:37.215586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t4hf4_186771ae-c742-409e-a72c-0f3c28044d48/payload-pre-processing/0.log" Jul 20 23:10:37.236395 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:37.236364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-pdlb4_36884052-c028-4828-a806-cd89d25ce7cd/payload-processing/0.log" Jul 20 23:10:40.654288 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:40.654259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jdnd4_7625b207-5003-4b35-81a8-1ceb34787057/migrator/0.log" Jul 20 23:10:40.672681 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:40.672651 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jdnd4_7625b207-5003-4b35-81a8-1ceb34787057/graceful-termination/0.log" Jul 20 23:10:42.023995 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.023968 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/kube-multus-additional-cni-plugins/0.log" Jul 20 23:10:42.044689 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.044617 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/egress-router-binary-copy/0.log" Jul 20 23:10:42.064602 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.064575 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/cni-plugins/0.log" Jul 20 23:10:42.086967 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.086940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/bond-cni-plugin/0.log" Jul 20 23:10:42.109646 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.109615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/routeoverride-cni/0.log" Jul 20 23:10:42.129793 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.129759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/whereabouts-cni-bincopy/0.log" Jul 20 23:10:42.148446 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.148410 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7jjtg_d0dd013d-75a2-47eb-b2bc-f27791ed859f/whereabouts-cni/0.log" Jul 20 23:10:42.519891 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.519864 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sxwd8_4dea5f9c-ce0e-4577-82e0-4dd1f6a7dbeb/kube-multus/0.log" Jul 20 23:10:42.657556 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.657526 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7v9x_20532715-6bae-4a56-85df-4baa1c1d52c1/network-metrics-daemon/0.log" Jul 20 23:10:42.674395 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:42.674360 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7v9x_20532715-6bae-4a56-85df-4baa1c1d52c1/kube-rbac-proxy/0.log" Jul 20 23:10:43.884128 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.884069 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/ovn-controller/0.log" Jul 20 23:10:43.900843 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.900800 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/ovn-acl-logging/0.log" Jul 20 23:10:43.924849 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.924820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/kube-rbac-proxy-node/0.log" Jul 20 23:10:43.946868 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.946839 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 23:10:43.964792 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.964766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/northd/0.log" Jul 20 23:10:43.984618 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:43.984589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/nbdb/0.log" Jul 20 23:10:44.004689 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:44.004661 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/sbdb/0.log" Jul 20 23:10:44.076038 ip-10-0-135-161 kubenswrapper[2568]: I0720 23:10:44.076005 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptqbj_88be9f91-2537-4aaa-ba00-a55857967ba6/ovnkube-controller/0.log"